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Abstract. Let L be a countable language. We say that a countable infinite 
L-structure M admits an invariant measure when there is a probability measure 
on the space of L-structures with the same underlying set as M that is invariant 
under permutations of that set, and that assigns measure one to the isomorphism 
class of M. We show that M admits an invariant measure if and only if it has 
trivial definable closure, i.e., the pointwise stabilizer in Aut(AI) of an arbitrary 
finite tuple of A4 fixes no additional points. When M is a Frai'sse limit in a 
relational language, this amounts to requiring that the age of M have strong 
amalgamation. Our results give rise to new instances of structures that admit 
invariant measures and ones that do not. 
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1. Introduction 

Randomness is used to construct objects throughout mathematics, and structures 
resulting from symmetric random constructions often exhibit structural regularities. 
Here we characterize, in terms of a combinatorial criterion, those countable struc- 
tures in a countable language that can be built via a random construction that is 
invariant to reorderings of the elements. 

A probabilistic construction is exchangeable when its distribution satisfies the 
symmetry condition of being invariant to permutations of its elements. When an 
exchangeable construction almost surely produces a single structure (up to isomor- 
phism), we say that the structure admits an invariant measure. Such structures 
often exhibit regularity properties such as universality or ultrahomogeneity. Two of 
the best-known randomly constructed structures with these regularities are Rado's 
countable universal ultrahomogeneous graph and Urysohn's universal separable ul- 
trahomogeneous metric space. The Rado graph may be generated as a random 
graph by independently choosing edges according to the Erdos-Renyi construction 
[ER59], and Urysohn space arises via an exchangeable construction by a result of 
Vershik [Ver02b], [Ver04]. 

Because these examples have such rich internal structure, it is natural to ask what 
other objects admit invariant measures. Petrov and Vershik [PV10] have recently 
shown via a new type of construction that the countable universal ultrahomogeneous 
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K n -fiee graphs all admit invariant measures. In the present work, we combine meth- 
ods from the model theory of infinitary logic with ideas from Petrov and Vershik's 
construction to give a complete characterization of those countable infinite struc- 
tures in a countable language that admit invariant measures. Specifically, we show 
that a structure A4 admits an invariant measure if and only if the pointwise stabi- 
lizer in Aut(A4) of any finite set of elements of M fixes no additional elements, a 
condition known as having trivial definable closure. 

Many natural examples of objects admitting invariant measures are generic, in the 
sense of being Fraisse limits, i.e., the countable universal ultrahomogeneous object 
for some class of finite structures [Hod93, §7.1]. One may ask what additional regu- 
larity properties must hold of Fraisse limits that admit invariant measures. Fraisse 
limits arise from amalgamation procedures for "gluing together" finite substructures. 
Our result implies that a Fraisse limit in a countable relational language admits an 
invariant measure if and only if it has strong amalgamation, a natural restriction on 
the gluing procedure that produces the limit. 

Our characterizations give rise to new examples of structures admitting invariant 
measures, and ones that do not. We apply our results to existing classifications of 
ultrahomogeneous graphs, directed graphs, and partial orders, as well as other com- 
binatorial structures, thereby providing several new examples of exchangeable con- 
structions that lead to generic structures. We also explicitly determine those count- 
able infinite commutative semigroups that admit invariant measures. Among our 
new examples are the countable universal ultrahomogeneous partial order [Sch79] 
and certain countable universal graphs forbidding a finite homomorphism- closed set 
of finite connected graphs [CSS99]; non-examples include Hall's countable universal 
group [Hod93, §7.1, Example 1], and any countable infinite tree. 

1.1. Background. 

The Rado graph sometimes known as the "random graph", is (up to iso- 
morphism) the unique countable universal ultrahomogeneous graph [Rad64]. It is 
the Fraisse limit of the class of finite graphs, with a first-order theory characterized 
by so-called "extension axioms" that have a simple syntactic form. It is also the 
classic example of a countable structure that has a symmetric probabilistic con- 
struction, namely, the countably infinite version of the Erdos-Renyi random graph 
process introduced by Gilbert [Gil59] and Erdos and Renyi [ER59]. For < p < 1, 
this process determines a random graph on a countably infinite set of vertices by 
independently flipping a coin of weight p for every pair of distinct vertices, and 
adding an edge between those vertices precisely when the coin flip comes up heads. 
Denote this random variable by G(oo,p). The random graph G(oo,p) is almost 
surely isomorphic to for any p such that < p < 1. Moreover, each G(oo,p) is 
exchangeable, i.e., its distribution is invariant under arbitrary permutations of the 
vertices, and so there are continuum-many different invariant measures concentrated 
on 3% (up to isomorphism) . It is natural to ask which other structures admit random 
constructions that are invariant in this way. 

Consider the Henson graph the unique (up to isomorphism) countable uni- 
versal ultrahomogeneous triangle- free graph [Hen71]. Like the Rado graph, it has 
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a first-order theory consisting of extension axioms, and can be constructed as a 
Fraisse limit. Does it also admit an invariant measure? In contrast with no 
countable random graph whose distribution of edges is independent and identically 
distributed (i.i.d.) can be almost surely isomorphic to But this does not rule out 
the possibility of an exchangeable random graph almost surely isomorphic to ^3. 
Its distribution would constitute a measure on countable graphs, invariant under 
arbitrary permutations of the underlying vertex set, that is concentrated on (graphs 
isomorphic to) 

One might consider building an invariant measure concentrated on 3&>, by "ap- 
proximating it from below" using uniform measures on finite triangle-free graphs, 
by analogy with the invariant measure concentrated on & obtained as the weak 
limit of uniform measures on finite graphs. The distribution of finite Erdos-Renyi 
random graphs G(n, ^) is simply the uniform measure on graphs with n labeled 
vertices; the sequence G(n, |) converges in distribution to G(oo, |), which is almost 
surely isomorphic to So to obtain an invariant measure concentrated on ^£3, 
one might similarly consider the weak limit of the sequence of uniform measures 
on finite triangle- free labeled graphs of size n, i.e., of the distributions of the ran- 
dom graphs G(n, |) conditioned on being triangle-free. However, by work of Erdos, 
Kleitman, and Rothschild [EKR76], this sequence is asymptotically almost surely 
bipartite, and so its weak limit is almost surely not isomorphic to Hence, as 
noted in [PV10], this particular approach does not produce an invariant measure 
concentrated on 

Petrov and Vershik [PV10] provided the first instance of an invariant measure 
concentrated on the Henson graph (up to isomorphism); they also did likewise 
for Henson's other countable universal ultrahomogeneous K n -fiee graphs, where 
n > 3. They produced this measure via a "top down" construction, building a 
continuum-sized triangle-free graph in such a way that an i.i.d. sample from its 
vertex set induces an exchangeable random graph that is almost surely isomorphic 
to 

In this paper, we address the question of invariant measures concentrated on arbi- 
trary structures. Given a countable language L and a countable infinite L-structure 
A4, we ask whether there exists a probability measure (on an appropriately defined 
space), invariant under arbitrary permutations of the underlying set of Ai, that 
assigns measure one to the isomorphism class of Ai. We provide a complete an- 
swer to this question, by characterizing such L-structures Ai as precisely those that 
have trivial group-theoretic definable closure, i.e., those structures Ai for which the 
pointwise stabilizer in Aut(A4) of any finite tuple a from Ai fixes no elements of Ai 
except those in a. We use infinitary logic to establish a setting in which, whenever 
Ai has trivial definable closure, we can, extending the methods of [PV10], construct 
continuum-sized objects that upon sampling give rise to invariant measures concen- 
trated on Ai. When Ai does not have trivial definable closure, we show that such 
invariant measures cannot exist. 

Our results build on several ideas from [PV10]. In particular, Petrov and Vershik 
show that if a continuum-sized graph satisfies certain conditions, then sampling from 
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that graph produces an invariant measure concentrated on j£§ (and similar results 
for St and the other Henson graphs). They proceed to construct continuum-sized 
graphs satisfying these conditions. In our infinitary setting, we are able to generalize 
their methods to produce invariant measures for a wide variety of target structures. 

Underlying Petrov and Vershik's construction of invariant measures is the charac- 
terization of countable exchangeable graphs as those obtained via certain sampling 
procedures from continuum-sized structures. These ideas were developed by Al- 
dous [Ald81], Hoover [Hoo79], Kallenberg [Kal92] and Vershik [Ver02a] in work on 
the probability theory of exchangeable arrays. More recently, similar machinery 
has come to prominence in the combinatorial theory of limits of dense graphs via 
graphons, due to Lovasz and Szegedy [LS06] and others. For an equivalence be- 
tween these characterizations, see Austin [Aus08a] and Diaconis and Janson [DJ08]. 
The standard recipe of [Aus08a] provides the most general formulation of the corre- 
spondence between sampling procedures on continuum-sized objects and arbitrary 
countable exchangeable structures. 

In the present paper, we are interested primarily in determining those countable 
infinite structures for which there exists at least one invariant measure concentrated 
on its isomorphism class. In the case of countable graphs, our construction in fact 
provides a new method for building graphons. In particular, the graphons we build 
are random-free, in the sense of [JanlO, §10]. Therefore our construction shows that 
whenever there is an invariant measure concentrated on the isomorphism class of a 
countable graph, there is such a measure that comes from sampling a random-free 
graphon. 

Within mathematical logic, the study of invariant measures on countable first- 
order structures goes back to work of Gaifman [Gai64] and Krauss [Kra69]. For a 
discussion of this earlier history and its relationship to Hoover's work on exchange- 
ability, see Austin [Aus08a, §3.8 and §4.3]. Our countable relational setting is akin 
to that explored more recently in extremal combinatorics by Razborov [Raz07]; for 
details see [Aus08a, §4.3] and [Aus08b]. 

Other work in model theory has examined aspects of probabilistic constructions. 
Droste and Kuske [DK03] and Dolinka and Masulovic [DM12] describe probabilistic 
constructions of countable infinite structures, though without invariance. Usvyatsov 
[Usv08] has also considered a relationship between invariant measures and notions 
of genericity in the setting of continuous first-order logic, especially with respect to 
Urysohn space. 

1.2. Main results. 

Our main theorem characterizes countable infinite structures Ai that admit in- 
variant measures as those for which the pointwise stabilizer, in Aut(A^), of an 
arbitrary finite tuple of M. fixes no additional points. For a countable language L, 
let Sl be the Borel measure space of L-structures with underlying set N. (This 
is a standard space on which to consider invariant measures; we provide details 
regarding Sl in §2.3.) Then we have the following result. 
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Theorem 1.1. Let L be a countable language, and let Ai be a countable infinite 
L-structure. The following are equivalent: 

(1) There is a probability measure on Sjj, invariant under the natural action of 
Sym(N) on Sl, that is concentrated on the set of elements of Sl that are 
isomorphic to Ai. 

(2) Group-theoretic definable closure in Ai is trivial, i.e., for every finite tuple 
a € Ai, we have dcLv((a) = a, where dcLx(a) is the collection of elements 
b € Ai that are fixed by all automorphisms of Ai fixing a pointwise. 

Note that every finite structure admits a natural probability measure that is 
invariant to permutations of the underlying set. But also every finite structure has 
nontrivial definable closure, and so the statement of our result does not extend to 
finite structures. 

A structure Ai is said to be ultrahomogeneous when every partial isomorphism 
between finitely generated substructures of Ai extends to an automorphism of Ai . 
Define the age of a countable -L-structure Ai to be the class of all finitely generated 
L-structures that are isomorphic to a substructure of Ai. The age of any count- 
able infinite ultrahomogeneous L-structure has the so-called amalgamation property, 
which stipulates that any two structures in the age can be "glued together" over any 
common substructure, preserving this substructure but possibly identifying other 
elements. Countable infinite ultrahomogeneous L-structures have been character- 
ized by Fra'isse as those obtained from their ages via a canonical "back-and-forth" 
construction using amalgamation; they are often called Fra'isse limits and are ax- 
iomatized by II2 "extension axioms". (For details, see [Hod93, Theorems 7.1.4, 
7.1.7].) 

A standard result [Hod93, Theorem 7.1.8] (see also [Cam90, §2.7]) states that 
when Ai is a countable infinite ultrahomogeneous structure in a countable rela- 
tional language, Ai has trivial definable closure precisely when its age satisfies the 
more stringent condition known as the strong amalgamation property, which requires 
that no elements (outside the intersection) are identified during the amalgamation. 
Note that in [Hod93, §7.1], strong amalgamation is shown to be equivalent to a 
property known as "no algebraicity" , which is equivalent to our notion of trivial de- 
finable closure for structures in a language with only relation symbols, but not when 
constant or function symbols are present. Thus we obtain the following corollary to 
our main theorem. 

Corollary 1.2. Let L be a countable relational language, and let Ai be a countable 
infinite L-structure. Suppose Ai is ultrahomogeneous. The following are equivalent: 

(1) There is a probability measure on Sl, invariant under the natural action of 
Sym(N) on Sl, that is concentrated on the set of elements of Sl that are 
isomorphic to Ai. 

(2) The age of Ai satisfies the strong amalgamation property. 

At the Workshop on Homogeneous Structures, held at the University of Leeds 
in 2011, Anatoly Vershik asked whether an analogue of the notion of a continuum- 
sized topologically universal graph [PV10] exists for an arbitrary Fra'isse limit. We 
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propose our notion of a (continuum-sized) Borel L-structure strongly witnessing a 
theory, denned in Section 3, as an appropriate analogue. 

Our results then show that such a Borel L-structure can exist for a Frai'sse limit 
precisely when its age has the strong amalgamation property. If the age of a Frai'sse 
limit Ai in a countable relational language L has the strong amalgamation property, 
then the proof of our main result involves building a Borel L-structure that, just like 
a topologically universal graph, has a "large" set of witnesses for every (nontrivial) 
extension axiom. On the other hand, when the age of Ai does not have the strong 
amalgamation property, such a Borel L-structure cannot exist; according to the ma- 
chinery of our proof, it would necessarily induce an invariant measure concentrated 
on Ai, violating Corollary 1.2. 

1.3. Outline of the paper. 

We begin, in Section 2, by describing our setting and providing preliminaries. 
Throughout this paper we work in a countable language L. We first describe the 
infinitary language £a, 1>w (L). In particular, we recall the notion of a Scott sentence, 
a single infinitary sentence in C Wl)W {L) that describes a countable structure up to 
isomorphism (among countable structures). We then show how to extend a count- 
able theory of £ WljW (L) to one that is in essence equivalent, but consists entirely 
of certain infinitary II2 sentences, which we can think of as "one-point" extension 
axioms. We go on to describe the measure space Sl and define the natural action 
of Sym(N) on Sl, called the logic action. Using these notions, we explain what we 
mean by invariant measure and what it means for a measure to be concentrated on 
a set. We then recall the group-theoretic notion of definable closure and its con- 
nection to the model theory of C Ul , u (L). Finally, we review some basic conventions 
from probability theory. 

In Section 3, we prove the existence of invariant measures concentrated on an L- 
structure Ai that has trivial definable closure, when L is a relational language. The 
invariant measures that we build come from sampling a continuum-sized structure, 
using a similar framework to that employed in [PV10] for graphs. 

The first-order theory of the Henson graph .Jfc, is generated by a set of II2 ax- 
ioms that characterize it up to isomorphism among countable graphs. In [PV10], 
Petrov and Vershik construct an invariant measure concentrated on ^3 by build- 
ing a continuum-sized structure that realizes a "large" set of witnesses for each of 
these axioms. In our generalization of their construction, we move to the setting of 
infinitary logic, in which we are able to provide analogous axioms associated with 
an arbitrary countable structure Ai. We accomplish this by taking a particular LI2 
theory T that implies the Scott sentence of Ai. This theory T has a single countable 
model (up to isomorphism), reducing our task to one of building a random countable 
structure that satisfies T almost surely. 

Having moved to this H2 theory T, we build a continuum-sized structure that 
satisfies T in a particularly strong way, analogously to [PV10]. Specifically, given 
a II2 sentence of the form (Vx)(3y) , 0(x, y) in T, we ensure that for every tuple a 
in the structure, the sentence (3y)i^(a,y) has a "large" set of witnesses, whenever 
ip(&, b) does not hold for any b 6 a. The construction proceeds inductively by 



INVARIANT MEASURES CONCENTRATED ON COUNTABLE STRUCTURES 8 

defining types on intervals, interleaving successive refinements of existing intervals 
with enlargements by new intervals that provide the "large" sets of witnesses. This 
is possible by virtue of T having a property we call duplication of quantifier-free 
types, which occurs precisely when M has trivial definable closure. The continuum- 
sized structure built in this way is such that a random countable structure induced 
by sampling from it, with respect to an appropriate measure, will be a model of T 
almost surely, thereby producing the desired invariant measure. 

In Section 4 we show that it is an easy step to extend the result of Section 3 to 
an arbitrary language L that may include constant and function, as well as relation, 
symbols. 

Section 5 provides the converse, for an arbitrary countable language L: If a 
countable infinite L-structure has nontrivial definable closure, it cannot admit an 
invariant measure. This is a direct argument that does not require the machinery 
developed in Sections 3 or 4. 

In Section 6 we apply our main theorem and its corollary for Frai'sse limits to 
obtain examples of countable infinite structures that admit invariant measures, and 
those that do not. Structures that satisfy our criterion include the countable univer- 
sal ultrahomogeneous partial order, Henson's family of continuum-many countable 
ultrahomogeneous directed graphs, certain countable universal graphs forbidding a 
finite homomorphism-closed set of finite graphs, and the rational Urysohn space. 
Furthermore, our results enable us to use existing classifications to give a complete 
list of those countable infinite ultrahomogeneous permutations, partial orders, di- 
rected graphs, and graphs, as well as connected-homogeneous graphs, that admit 
invariant measures. We also describe some of the limited kinds of examples that 
can occur in a language with function symbols. In addition, we give examples of 
countable structures having arbitrary Scott rank that admit invariant measures, and 
examples of those that do not admit invariant measures. 

We conclude, in Section 7, with several connections to the theory of graph limits, 
and additional applications of our results. 

2. Preliminaries 

Throughout this paper we use uppercase letters to represent sets, lowercase letters 
to represent elements of a set and lowercase boldface letters to represent finite tuples 
(of variables, or of elements of a structure). The length |x| of a tuple of variables x is 
the number of entries, not the number of distinct variables, in the tuple, and likewise 
for tuples of elements. We use the notation (xi, . . . , Xk) and x\ ■ ■ ■ X}- interchangeably 
to denote a tuple of variables x of length k that has entries x\, . . . , Xk, in that order, 
and similarly for tuples of elements. When it enhances clarity, we write, e.g., (x, y) 
for (x\, X2, yi, V2j, when x = 2:1x2 and y = yxyi- For an n-tuple a £ A n , we 
frequently abuse notation and write a £ A Similarly, for a measure m on a set X, 
we sometimes write m to denote the product measure m n on X n . 

2.1. Infinitary logic. 

We begin by reviewing some basic definitions from logic. A language L, also 
called a signature, is a set L := 1Z U C U T , where 1Z is a set of relation symbols, 
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C is a set of constant symbols, and J 7 is a set of function symbols, all disjoint. For 
each relation symbol R E 1Z and function symbol / E T , fix an associated positive 
integer, called its arity. We take the equality symbol, written =, to be a logical 
symbol, not a binary relation symbol in L. In this paper, we always take L to be 
countable. 

Given a language L, an L-structure A4 is a non-empty set M endowed with 
interpretations of the symbols in L, namely, an m-ary relation R M C M m for each 
R E 1Z of arity m, a distinguished element c M E M for each c E C, and an n-ary 
function : M n — )• M for each / E J 7 of arity n. The equality symbol is always 
interpreted in a structure to mean actual equality of elements of the underlying 
set. We sometimes write x E M in place of x E M, and refer to elements of the 
underlying set M as "elements of the structure A4" . 

Roughly speaking, a language L provides a template for the potential relations, 
constants and functions of a structure, and an L-structure A4 is a realization of this 
template. For example, for the language Lbin = {-^}> where R is a binary relation 
symbol, any graph Q = (V, E) may be considered an Lbi n -structure by taking Rp 
to be its edge relation E. Any partial order X = (X, <) is also an Lbi n -structure, 
when R x is interpreted as its order relation < . As another example, consider the 
language L gr oup = {e, *, ( • where e is a constant symbol, where * is a binary 

function symbol, and where ( • ) _1 is a unary function symbol. Any group K. is an 
Lgroup-structure when e K is its identity element, when * K is its multiplication, and 
when f( • is its inverse operation. 

Note that specifying a language L determines the number and arities of relations, 
constants, and functions in L-structures, but does not impose any axioms on them. 
For instance, not all L group -structures are groups; even a lattice A may be construed 
as an L group -structure when is the maximum element, when *^ is the least upper 

bound function, and when (( • is the identity function. A group is precisely an 

Lgroup-structure that additionally satisfies the three axioms of the theory of groups. 

We now describe the class C Wl , w (L) of infinitary formulas in the language L. For 
the basics of first-order languages, terms, formulas, and theories, see [Mar02, §1.1], 
and for more on infinitary logic and Scott sentences, see [Kei71], [Bar75], or [Mar02, 
§2-4]. 

Definition 2.1. Fix a countably infinite set of variables from which all formulas 
will be constructed. The class jO UltOJ (L) is the smallest collection of formulas that 
contains all atomic formulas of L and also the formulas (3x)tp(x) and where 
ijj(x),x E C UliU (L), as well as the formula f\ ieI fi, where / is an arbitrary countable 
set, each ipi E C Ul ^{L), and the set of free variables of ¥i is finite. 

A formula of C (JJl ^{L) may have countably infinitely many variables, but only 
finitely many that are free. Note that the more familiar £ WjtJ (L), consisting of 
first-order formulas, is the restriction of C Wl)W (L) where conjunctions are over finite 
index sets /. As is standard, we will freely use the abbreviations V := -izH and 
V := -i f\ -i, as well as binary A and V, in formulas of £ WljW (L). We will sometimes 
refer to formulas of C Ul ^{L) as L-formulas. 
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A sentence is a formula with no free variables. A (countable) theory of C U1)Ij j{L) 
is an arbitrary (countable) collection of sentences in C^^L). Note that a theory 
need not be deductively closed. 

For a formula <p(xi, . . . , x n ) of £^ liW (L), whose free variables are among x%, . . . , x n , 
all distinct, the notation Ai |= ip(a\, . . . , a n ) means that <p(xi, . . . , x n ) holds in Ai 
when instantiated by the elements ai,...,a n of the underlying set 

M. In particular, for a sentence (p of £ Wl)£i ,(L), the notation Ai |= 99 means that 
the structure A4 satisfies the sentence ip. (See [Kei71], [Bar 75], or [Mar02, §2.4] for 
formal details.) 

For a theory T, we write Ai \= T to mean that A4 |= (/? for every sentence ip £ T; 
in this case, we say that Ai is a model of T. We write T |= <p to mean that the 
sentence ip is true in every L-structure that is a model of T. As a special case, we 
write |= ip to mean |= ip, i.e., the sentence ip is true in every L-structure. When 
■0(x) is a formula with free variables among the finite tuple x, we write |= to 
mean |= (Vx)^(x). 

Suppose the language L is contained in the language L' , written L C V . Given 
an L-structure Ai and an L'-structure Ai' , we say that Ai is the reduct of Ai' to 
L when Ai and A4' have the same underlying set and every quantifier-free formula 
ip G £ WljaJ (L) satisfies 

Ai \= ip if and only if Ai' \= ip. 

In other words, Ai is obtained from Ai' by "forgetting" all relations, functions, and 
constants whose corresponding symbols are not in L. In this case we call Ai' an 
expansion of Ai . 

Definition 2.2. A countable set A C C Wl)W {L) is called a fragment when it con- 
tains all formulas of the form (3x)ip, -1^, and % A rj, where ip, \i V G A, all formulas 
of £uj,u)(L), and is closed under subformulas and changes of variables. 

A key model-theoretic property of C^^L) is that any countable L-structure can 
be characterized by a single sentence of £ WljCJ (L). 

Proposition 2.3 (see [Bar 75, Corollary VII.6.9] or [Mar02, Theorem 2.4.15]). Sup- 
pose L is a countable language and Ai is a countable L-structure. Then there is a 
sentence ip 6 C^^L), called the (canonical) Scott sentence of Ai, such that for 
every countable L-structure N ' , we have N \= ip if and only if M = Ai. 

2.2. Pithy U 2 theories. 

Countable theories consisting of "extension axioms" will play a crucial role in 
our main construction. In fact, we will work with a notion of "one-point extension 
axioms", which allows us to realize witnesses for all possible finite configurations, 
one element at a time. In a sense that we make precise here, an arbitrary countable 
theory of £u 1)W (L) is equivalent to a countable theory (in an expanded language) 
consisting only of one-point extension axioms. We note that Hoover [H0086] makes 
use of a similar transformation to a theory consisting of one-point extension axioms, 
in the course of studying asymptotic probabilities in classes of finite structures. 
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Definition 2.4. A sentence in C^^L) is II2 when it is of the form (Vx)(3y)*0(x, y), 
where the (possibly empty) tuple xy consists of distinct variables, and tp(x.,y) is 
quantifier- free. A countable theory T of C^^i^L) is II2 when every sentence if £ T 

is n 2 . 

Given a countable fragment A of C UJltUJ {L), one can enlarge the language L to 
a countable language V so that every //-formula is equivalent (with respect to a 
particular conservative IT2 extension Wa of the empty theory) to an L-formula, 
while ensuring that every formula in A is equivalent (with respect to Wa) to both 
a universal formula and an existential L'-formula. This is similar to what is known 
in the first-order context as the Morleyization of the theory, and is a standard 
construction that expands the language to include a relation for every formula in 
A. In particular, every formula of jC U]1iLU (L') is equivalent (with respect to Wa) to 
a formula of C LUl:LU (L); an extension Wa having this property is sometimes called 
definitional 

Lemma 2.5. Suppose L is a countable language and A is a countable fragment of 
>C Wl)W (L). Consider the countable language V := L U {R^ : ip G ^4}, where each 
new relation symbol has arity one more than the number of free variables in ip. 
There is a countable II2 theory Wa of £ Wl)W (X/) such that 



for all ip £ A, where x is the tuple of free variables of ip. 

Proof. Let Wa be the theory consisting of the following H2 sentences: 

• (Vx, w)[Rp(x, w) <->■ -P(x)] for P a relation symbol in L of arity |x|, 

• (Vx, w)[R c (y, w) •<-)■ c = y] for c a constant symbol in L, 

• (Vx, w)[Rf(x, y, w) <-> /(x) = y] for / a function symbol in L of arity |x|, 

• (yx,w)[R^(x,w) O -■.??</, (x,u>)], 

• (Vx,w)[iJ A . 67 ^(x,u;) o Aie/^O^)]' 

• (Vx,io)[i?( gj/ ) ¥) (x,u;) O (3y)^(x,y,u;)], and 

• (Vx,u;)[ J R (3y)v ,(x,ii;) O (3y)i^(x, w)], 

where x is a tuple containing precisely the free variables of ip S A, where ipi £ A, 
where the tuple ZjCx contains precisely the free variables of ipi for each i £ I, and 
where the free variables of if £ A are precisely the variables in xy, with y g" x. It is 
clear that is a countable II2 theory and that all of its models satisfy the desired 
sentences. □ 

Definition 2.6. Let L be a countable language, and let A be a countable fragment 
of C Ul ^{L). Suppose T is a countable theory of C UJljUJ (L) such that TCi The H2 
expansion of T to j4 is defined to be the countable LI2 theory 



of £ Wl)W (-Z/), where Wa is as in Lemma 2.5. 

Note that in Lemma 2.5, we included the dummy variable w in order to ensure 
that for every ip £ A, there is a universal formula that is equivalent to ip in every 



W A |= (Vx) ((V 



'w)R^(x,w) O VK X )) A ((3w)i?^,(x, u>) o ip(x 



)) 



2 v :=l^U{(Vtfl)fl x H 
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model of Wa, even for quantifier- free ip. This allows us to replace a countable theory 
T, in the language L, by T' , its encoding in L' , rather than simply augmenting it 
with Wa- This makes T" itself a II2 theory, rather than merely equivalent to some 
II2 theory, as occurs in the usual first-order Morleyization [Hod93, Theorem 2.6.6]. 
It is important for our main construction in Section 3 that we work with a countable 
II2 theory of C MllU) (L), and this maneuver allows us to do so. 

The following lemma is an immediate generalization of [Hod93, Theorem 2.6.5] 
to countable fragments of C UX]W {L). 

Lemma 2.7. Let L be a countable language, and let A be a countable fragment of 
£w\,w{L). Suppose T is a countable theory of C^ 1%U1 {L) such that T C A, and let T' 
be the II2 expansion of T to A. Then every countable model M of T has a unique 
expansion to a countable model A4' of T 1 . Furthermore, for every V -formula 
there is an L-formula x( x ) such that T' \= V>( x ) x( x )- 

Hence the expansion adds essentially no new information to the original structure. 
In particular, every L-structure A4 has a unique expansion to an L'-structure Ai' 
that models Wa- 

In our construction, it will be convenient to work with a restricted kind of exten- 
sion axiom, namely a II2 sentence of the form (Vx)(3y)ip(x, y), where y is a single 
variable. Under this restriction, for each instantiation a of x, we will be able to 
realize witnesses for (3y)ip(a, y) one element at a time. This motivates the following 
definition. 

Definition 2.8. A II2 sentence (Vx)(3y)-i/>(x, y) G C^^iL), where ip(x, y) is quanti- 
fier-free, is said to be pithy when the tuple y consists of precisely one variable. A 
countable II2 theory T of £ a;ijW (L) is said to be pithy when every sentence in T is 
pithy. Note that we allow the degenerate case where x is the empty tuple and ip is 
of the form (3y)ip(y). 

We may consider pithy H2 sentences to be a formalization of the notion of "one- 
point extension axioms" in our infinitary setting. Note that a pithy II2 sentence 
can be written uniquely in the form (Vx)(3y)-0(x, y), where ip is quantifier-free, and 
where the free variables of ip are among x, y. The following lemma is immediate. 

Lemma 2.9. Suppose L is a countable language and A is a countable fragment of 
£ui,uj(L). Define the set of formulas 

B := AU {(Vx)(3y^,)('0(x) A {y^ = y^)) : (Vx)-(/;(x) G A and i/j is quantifier-free}, 

where y^ is a variable that is not free in ip. Consider the II2 formulas 

(Vx)(3yi • • • 2/ n )^(x, yi ■ ■ ■ y n ) e B, 

where the free variables of each ip(x, yi • • • y n ) are among x, y\ ■ ■ ■ y n and ip is quanti- 
fier-free. Let y denote y\- ■ -y n and define the countable language 



L A := LU {#$ (xy) : (Vx)(3yi---y n )^(x,2/i,...,y n ) G B and < k < n - l}, 
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where each if) is as above and each E^,^ is a new relation symbol of arity |x| + k. 
There is a countable pithy II2 theory Z A of C UltU (L A ) such that 

Z A |= (Vx)(4 (xy) (x, yi • • -y k ) o Oy k+1 )E^ y) (x, yi ■ ■ -y k+1 )) 

for < k < n — 1, and 

Z A \= (Vx.)(E™-* y) (x,yi ■ --yn-i) O (3y n )V>(x,yi • • -y n )), 

for every formula ip as above. 

We now describe how to form a countable pithy LT2 expansion. 

Definition 2.10. Let L be a countable language, and let A be a countable fragment 
of C Wl<ul (L). Suppose T is a countable theory of £ wli ^(L) such that T C A. Write T' 
for the theory of C W1UJ {L') that is the II2 expansion of T to A, as in Definition 2.6. 
Define the pithy LT2 expansion T A of T to A to be the countable pithy II2 theory 

T A := Z A U {(Vx)£° (xy) (x) : (Vx)(3yi • ■■y n )^,yx ■■■y n )€ T'} 

of ^^^(L^), where is as in Lemma 2.9, the free variables of each ^(x, y\ - ■ ■ y n ) 
are among x, y\ ■ ■ ■ y n , and if) is quantifier- free. 

By composing Lemma 2.7 with its analogue based on Lemma 2.9 about encoding a 
countable II2 theory in a countable pithy II2 theory, we obtain the following lemma. 

Lemma 2.11. Let L be a countable language, and let A be a countable fragment 
of C Ulj ui(L). Suppose T is a countable theory of C (jJi ^{L) such that T C A, and 
let T A be the pithy LT2 expansion of T to A. Then every countable model Ai of T 
has a unique expansion to a countable model M A of T A . Furthermore, for every 
L A -formula ip(x) there is an L- formula x( x ) such that T A \= x( x )- 

In Section 3, when we construct an invariant measure concentrated on an L- 
structure M., we will work with the pithy II2 expansion of the Scott sentence of 
M. 

For a relational language L, when a fragment A contains the Scott sentence of 
a countable L-structure Ai, as will be the case in the proof of Theorem 3.20, the 
expansion Ai A (as above) can be shown to be ultrahomogeneous, hence a Frai'sse 
limit. Therefore, even if Ai is not ultrahomogeneous itself, there is an essentially 
equivalent structure Ai A to which Corollary 1.2 could be applied. In fact, the 
expansion Ai A has strong amalgamation precisely when Ai has trivial definable 
closure. 

2.3. The logic action on the measurable space Sl- 

For an arbitrary countable language L, we define the measurable space Sl to 
be the set of L-structures that have underlying set N, equipped with the Borel 
cr-algebra, i.e., the cr-algebra generated by subbasic open sets of the forms 

R(n u ..., nj ) := {AteS L : R M {m, . . . , n,)}, 

where R G L is a j-ary relation symbol and ni, . . . ,rij E N, 

c(£) := {Ai£S L : c M =£}, 
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where c G L is a constant symbol and f £N, and 

/(ni,...,n fcl *) := {M £ S L : f M (m,...,n k ) = £}, 

where / G L is a fc-ary function symbol and ni, . . . ,n k ,l G N. We extend this 
notation in the standard way to arbitrary formulas ip(xi, ... ,Xj) G C UljU (L) so that 

<p(ni, . . . ,rij) := {Ai G S L : M \= <p(rai, . . . ,n.,)}. 

For any sentence </? of £ Wl)W (L), the set (p is Borel, by [Kec95, Proposition 16.7]. 
Given a countable L-structure Ai, recall that the Scott sentence a_M G £ Wl)W (L) 
determines .M up to isomorphism among countable structures. Therefore the iso- 
morphism class of Ai is Borel. 

Denote by Sym(N) the permutation group of N. There is a natural group action, 
called the logic action, of Sym(N) on Sl, induced by permutation of the underlying 
set N. For more details, see [Kec95, §16.C]. Note that the orbit of an L-structure 
Ai G Sl under this action is the isomorphism class of Ai. We call a (Borel) measure 
m on Sl invariant when it is invariant under the action of Sym(N), i.e., for every 
Borel set X C Sl and every g G Sym(N), we have m(X) = m(g ■ X). 

Let m be a probability measure on Sl- We say that m is concentrated on a Borel 
set X C Sl when m(X) = 1. We are interested in structures up to isomorphism, 
and for a countable infinite L-structure Ai, we say that m is concentrated on Ai 
when m is concentrated on its isomorphism class {M G Sl '■ N — Ai} in Sl- We 
say that Ai admits an invariant measure when such an m exists. 

2.4. Definable closure. 

Our characterization of structures admitting invariant measures is in terms of the 
group-theoretic notion of definable closure. 

An automorphism of an L-structure Ai is a bijection g : M — >• M such that 

R M (g(a 1 ),...,g(a m )) if and only if R M {a\, . . . , a m ) 

for every relation symbol R G L of arity m and elements a±, . . . , a m G Ai, 

9{c M ) = c M 

for every constant symbol c G L, and 

f M {g(b 1 ),...,g(b n ))=g{f M (b 1 ,...,b n )) 

for every function symbol / G L of arity n and elements b\, . . . ,b n £ Ai. 

Definition 2.12. Let Ai be an L-structure, and let a G Ai. The definable closure 

of a in Ai, denoted dcLvj(a), is the collection of elements b G Ai that are fixed by 
all automorphisms of Ai fixing a pointwise. In other words, dcLv((a) is the set of 
b G Ai for which the set 

{g(b) ■ 9 G kvX(M) s.t. (Va G a) g(a) = a] 

is a singleton, namely {b}. 
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This notion is sometimes known as the group-theoretic definable closure. For 
countable structures, it has the following equivalent formulation in terms of the 
formulas of Cu ltW (L) that use parameters from the tuple a. 

Given an L-structure Ai and a tuple a G Ai, let L a denote the language L 
expanded by a constant symbol for each element of a. Then let Ai a denote the 
L a -structure Ai with the entries of a named by their respective constant symbols 
in L a . 

Lemma 2.13 (see [Hod93, Lemma 4.1.3]). Let L be a countable language, and let 
Ai be a countable L-structure with a G Ai. Then b G dcLvi(a) if and only if there 
is a formula (p G C lJJljUJ (L a ) whose unique realization, in .A/i a is 6 ? i.e., 

Ma |= <f{b) A {{Vx,y)(tp{x) Aip(y)) x = y). 

When the first-order theory of Ai is tto-categorical, it suffices to consider only 
first-order formulas <p G C U)U in Lemma 2.13 (see [Hod93, Corollary 7.3.4]); in this 
case, group-theoretic definable closure coincides with the standard notion of model- 
theoretic definable closure. 

Definition 2.14. We say that an L-structure Ai has trivial definable closure 

when the definable closure of every tuple a G Ai is trivial, i.e., dcLvj(a) = a for all 
a G Ai. 

It is sometimes more convenient to work with (group-theoretic) algebraic closure. 

Definition 2.15. Let Ai be an L-structure, and let a G Ai. The algebraic closure 

of a in Ai , denoted acLvi (a) , is the collection of elements b G Ai whose orbit under 
those automorphisms of Ai fixing a pointwise is finite. In other words, acLvj(a) is 
the set of b G Ai for which the set 

{g(b) ■ 9 G Aut(X) s.t. (Va G a) g(a) = a] 

is finite. We say that Ai has trivial algebraic closure when the algebraic closure 
of every tuple a G Ai is trivial, i.e., acl J vj(a) = a for all a G Ai. 

Note that an L-structure has trivial algebraic closure if and only if it has trivial 
definable closure; this fact will be useful in Section 6 when we find examples of 
structures admitting invariant measures. 

2.5. Basic probability notions. 

Throughout this paper, we make use of conventions from measure-theoretic prob- 
ability theory to talk about random structures having certain almost-sure properties. 
For a general reference on probability theory, see, e.g., [Kal02]. 

Let (Q,G,P) be a probability space, and suppose (H,7i) is a measurable space. 
Recall that an H -valued random variable Z is a (Q, %)-measurable function 
Z : ft —7- H. Such a function Z is also sometimes called a random element in 
H. The distribution of Z is defined to be the probability measure P o Z . Given 
a property E G H, we say that E holds of Z almost surely, abbreviated a.s., when 
P(Z~ 1 (E)^j = 1. Sometimes, in this situation, we say instead that E holds of Z 
with probability one. For example, given a random element Z in Sl and a Borel 
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set (p, where (p is a sentence of C UliU (L), we say that <p holds of Z a.s. when 
P(Z _1 (^)) = P({ui G : Z(w) |= <^}) = 1. In fact, we will typically not make the 
property explicit, and will, for instance, write that the random structure Z \= ip a.s. 
when P({u> G 0, : Z(w) |= ip}) = 1. Sometimes this probability is abbreviated as 
¥{Z |= c/?}. In the proof of our main theorem, when we show that a measure // on 
S 1 /, is concentrated on the set of models of (p, we will do so by demonstrating that, 
with probability one, Z |= (p, where Z is a random structure with distribution \i. 

A sequence of (LLvalued) random variables is said to be independent and identi- 
cally distributed, abbreviated i.i.d., when each random variable has the same distri- 
bution and the random variables are mutually independent. When this distribution 
is m, we say that the sequence is m-i.i.d. 

3. Existence of invariant measures (relational languages) 

We now turn to the construction of invariant measures concentrated on an arbi- 
trary countable infinite structure having trivial definable closure. In this section, 
unless otherwise noted (as in §3.3 and Lemma 3.19), we work in a countable re- 
lational language L. Theorem 3.20 constitutes one direction of the main result 
of this paper, Theorem 1.1, in the case of relational languages. In Section 4 we 
will generalize this to arbitrary countable languages, thereby proving one half of 
Theorem 1.1. 

The following is an outline of our proof; in the presentation below we will, how- 
ever, develop the machinery in the reverse order. Let A4 be a countable infinite 
L-structure with trivial definable closure, and let A be a countable fragment of 
£un,u)(L) containing the Scott sentence of Ai. Let Ta be the pithy II2 expansion 
to A of this Scott sentence, as in §2.2. We show, in §3.5, that such a theory Ta of 
£uh,ui{La) has a property that we call duplication of quantifier-free types. In §§3.3- 
3.4, we use this property to build a Borel LA-structure V that strongly witnesses Ta- 
Roughly speaking, V is a structure on R with Borel relations such that for every 
pithy II2 sentence (Vx)(3y)<y9(x, y) G Ta and tuple a£?of the appropriate length, 
either there is a "large" set of elements b G V such that (p(a, b) holds, or else there 
is some b G a such that ip(a,b) holds; in either case, (3y)<p(a,y) is "witnessed". 
In §§3.1-3.2 we show how to use a Borel LA-structure that strongly witnesses Ta 
to produce an invariant measure concentrated on models of Ta that are in Sl a - 
Because Ta implies the Scott sentence of A4, this invariant measure must be con- 
centrated on L^-structures whose reducts to L are isomorphic to M. We thereby 
obtain an invariant measure on Sl concentrated on A4. 

3.1. Sampling from Borel L-structures. 

We begin by introducing a certain kind of L-structure with underlying set M, 
whose relations are Borel (with respect to the standard topology on R). We will use 
such structures to induce invariant measures on Sl. Our definition is motivated by 
Petrov and Vershik's notion of a Borel graph [PV10, Definition 1]. The model theory 
of such Borel structures has earlier been studied by Harvey Friedman (published in 
[Ste85]). For a survey, including more recent work, see [MN10, §1]. 



INVARIANT MEASURES CONCENTRATED ON COUNTABLE STRUCTURES 17 

Definition 3.1. Let V be an L-structure whose underlying set is R. We say that 
V is a Borel L-structure if for all relations R £ L, the set 

{a G V j : V |= /2(a)} 

is a Borel subset of M- 7 , where j is the arity of R. 

Note that although structures with underlying set IR will suffice for our purposes, 
we could have defined the notion of a Borel L-structure more generally, for other 
measure spaces. 

Next we describe a map taking a sequence of elements of an arbitrary L-structure 
to the corresponding L-structure with underlying set N. We will apply this map to a 
random sequence of elements of a Borel L-structure to induce a random L-structure 
with underlying set N. 

Definition 3.2. Suppose M is an L-structure (of arbitrary cardinality). Define the 
function Tj^f : M u ->■ Sl as follows. For A = (ai) ieuJ G 7V W , let Tf/(A) be the 
L-structure with underlying set N satisfying 

TV(-A-) \= R(ni,...,rij) 44> AT \= R(a ni , . . . , a n . ) 

for every relation symbol R G L and for all ni, . . . , rij G N, where j is the arity of 
R, and for which equality is inherited from N, i.e., 

JV(A) |= (m^n) 

just when m and n are distinct natural numbers. 

When the sequence A G N u has no repeated entries, J-)v'(A) G Sl is isomorphic 
to a countable infinite substructure of N . In fact, this will hold a.s. for the random 
L-structures that we construct in §3.2. 

Lemma 3.3. Let V be a Borel L-structure. Then T-p is a Borel measurable function. 

Proof. Recall the definition of the Borel cr-algebra on Sl in §2.3. Suppose 
R G L is a j-ary relation symbol, and let ni, . . . ,nj G N. It suffices to show that 
J r p 1 (i?(ni, . . . , rij)) is Borel, because L is a relational language, and the preimages 
of sets defined by equality are trivial. 

Let 7r nii ... jni : — > V J be the projection map defined by 

^rii,...,rij — iflni > • • • j ) i 

this map is Borel. Then 

T^{R{m, . . .,nj)) = ^...^.({a G V j : V |= /2(a)}), 

as both sides of the equation are equal to 

{(ai)ieu, G V u : V |= Z2(a„ x , . . . , a n .)}. 

By Definition 3.1 we have that {a G :V |= /?(a)} is Borel. Hence 
J r p 1 (/2(ni, . . . ,7^-)) is also Borel and T-p is a Borel measurable function. □ 
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Next we show how to induce an invariant measure on Sl- Suppose m is a (Borel) 
probability measure on R. Denote by m°° the corresponding product measure on 
M. u , i.e., the distribution of a sequence of independent samples from a probability 
measure m. Note that m°° is invariant under arbitrary reordering of the indices. 
We will obtain an invariant measure on Sl by taking the distribution of the random 
structure with underlying set N corresponding to an m-i.i.d. sequence of elements 
of a Borel L-structure. 

This technique for constructing invariant measures by sampling a continuum- 
sized structure was used by Petrov and Vershik [PV10], and the following notation 
and results parallel those in [PV10, §2.3]. A similar method of sampling is used in 
[LS06, §2.6] to produce the countable random graphs known as W-random graphs 
from continuum-sized graphons; for more details on the relationship between these 
notions and our construction, see §7.1. 

Definition 3.4. Let V be a Borel L-structure, and let m be a probability measure 
on R. Define the measure H(T>m) on Sx to be 

M(7>,m) : = m°° of' 1 . 

In other words, /t*(p m ) is the distribution of a random element in Sl induced via 
J--p by an m-i.i.d. sequence on K. 

The following lemma makes precise the sense in which the invariance of m°° (under 
the action of Sym(N)) yields the invariance of fJ>t-p m ) (under the logic action). 

Lemma 3.5. Let V be a Borel L-structure, and let m be a probability measure on 
R. Then jtt/p m ) is an invariant probability measure on Sl- 

Proof. Note that fJ-(-p >m ) is a probability measure on Sl because m is a probability 
measure and T-p is a measurable function. It suffices to verify that li{T>,m) is invariant 
on a 7r-system (i.e., a family of sets closed under finite intersections) that generates 
the Borel cr-algebra on Sl, by [Wil91, Lemma 1.6.b]. We first show that /i(-p )m ) 1S 
invariant on subbasic open sets R determined by relations R € L, and then show its 
invariance for the 7r-system consisting of sets tp determined by finite conjunctions <p 
of relations in L. 

Let R be a j-sxy relation in L, and let ni,...,nj £ N. Consider the set 
R{n\, . . . ,n,j), as defined in §2.3, and let g G Sym(N). Note that 

R(g(n 1 ),...,g(n j )) = {g ■ N : N € R{n\, . . ■,%)}, 
where • denotes the logic action of Sym(N) on Sl- We will show that 

M(7>,m) (-R(ff(«l))---)5(»j))) = ^(V,m)[R(ni,---,nj)). (*) 

We have 

T v ' (%(m), . . -,g( nj ))) = ^...^({a eV^-.V (= i?(a)}) 

and 

T^{R{nx, . . .,n 3 )) = 7^...^. ({a (= «( a )})- 
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Because m°° is invariant under the action of Sym(N) on M. u (given by permuting 
coordinates of R w ), the Borel subsets 

^v 1 (-R(ff( n i)i • • -jff^i))) 

and 

J - P 1 (i?(ni,.. . ,rij)) 
of R w have equal m°°-measure, and so (*) holds. 

Now consider relations R\, . . . , R k € L of respective arities ji, ■ ■ ■ ,jk, and let j' := 
X^Liifc- Denote the conjunction of these relations on non-overlapping variables by 
the formula 

ip(x 1} . . .,Xf) := Ri(x!, . . .,x h ) A • • • AR k (xj>- jk+ x, . . .,xj>), 
where distinct variables. We have 

<p(m, . . .,nf) = J?i(ni, . . . ,71^) n • • • n R k (nj,_ jk+1 , . . .,nf), 

for all m, ... , rij' G N (not necessarily distinct), and from this we see that 
and 

F^ l {(p[n u ...,nj>)) 

have equal m°°-measures. Hence /U(-p jm ) is invariant under the logic action. □ 

We now consider the set of L-structures on which such a measure fJ-rp jTn -\ is con- 
centrated. Recall that a measure on R is said to be continuous (or nonatomic) if 
it assigns measure zero to every singleton. 

Lemma 3.6. Let V he a Borel L- structure, and let m be a continuous probability 
measure on R. Then the probability measure /J(p jm ) is concentrated on the isomor- 
phism classes (in Sl) of countable infinite substructures ofV. 

Proof. Let A = (aj)i gaJ be an m-i.i.d. sequence of R. Note that the induced count- 
able structure J--p(A) is now a random L-structure, i.e., an S^-valued random vari- 
able, whose distribution is ^(v,m)- Because m is continuous, and since for any k ^ I 
the random variables a k and ai are independent, the sequence A has no repeated 
entries a.s. Hence F-p{A) is a.s. isomorphic to a countable infinite (induced) sub- 
structure of "P. □ 

3.2. Strongly witnessing a pithy H2 theory. 

We have seen how to construct invariant measures on Sl by sampling from a Borel 
-L-structure. We now describe a property of Borel L-structures V that will give us 
sufficient control over such measures to ensure that they are concentrated on the 
models of a given countable pithy n2 theory T of C Ul>U} (L). For this we define when 
the Borel L-structure V and a measure m witness T, generalizing the key property 
of Petrov and Vershik's universal measurable graphs in [PV10, Theorem 2]. From 
this, we define when V strongly witnesses T, a notion that we find more convenient 
to apply. 

We begin by defining the notions of internal and external witnesses. 
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Definition 3.7. Let ftA be an L-structure containing a tuple a, and let ip(x,y) be 
a quantifier- free formula of C Wl>w (L), all of whose free variables are among xy. We 
say that an element b G A4 is a witness for (3y)ijj(&,y) when Ai |= ip(a,b). We 
say that such a b is an internal witness when b G a, and an external witness 
otherwise. 

Recall that a measure m on M is said to be nondegenerate when every nonempty 
open set has positive measure. 

Definition 3.8. Let V be a Borel L-structure and let m be a probability measure 
on E. Suppose T is a countable pithy II2 theory of C WltW (L). We say that the pair 
(V,m) witnesses T if for every sentence (Vx)(3y)^(x, y) G T, and for every tuple 
a G "P such that |a| = |x|, we have either 

(%) V |= V^ 21 ) 6) for some 6 G a, or 

(%%) m({b eV :V\= ip(a, b)}) > 0. 
We say that V strongly witnesses T when, for every nondegenerate probability 
measure m on R, the pair (V,m) witnesses T. 

Intuitively, the two possibilities (i) and fiij say that witnesses for (3y)t/j(a,y) are 
easy to find: either an internal witness already exists among the parameters a, or 
else witnesses are plentiful elsewhere in the structure V, according to m. The notion 
of strongly witnessing simply allows us to work without keeping track of a measure 
m. In fact, when we build structures V that strongly witness a theory, in §3.4, we 
will be even more concrete, by declaring entire intervals to be external witnesses. 

These definitions generalize two of the key notions in [PV10]. Let Lq be the 
language of graphs. A universal measurable graph (X, m, E) as defined in [PV10, 
Definition 3] roughly corresponds to a Borel Lg-structure (X, E) with vertex set X 
and edge relation E for which ((X,E),m) witnesses the theory of the Rado graph 
2%. A topologically universal graph (X, E) as defined in [PV10, Definition 4] roughly 
corresponds to a Borel L^-structure that strongly witnesses the theory of 3% by 
virtue of entire intervals being witnesses. The following results in §3.2 are inspired 
directly by Petrov and Vershik's constructions. 

We will use (continuum-sized) Borel L-structures strongly witnessing a theory T 
to produce random countable structures that satisfy T almost surely. However, we 
first note that the property of strongly witnessing is powerful enough to ensure that 
the Borel L-structure is itself a model of T. 

Lemma 3.9. Let V be a Borel L-structure, and let T be a countable pithy LI2 theory 
of C UljU (L). IfV strongly witnesses T, then V \=T. 

Proof. Fix a pithy II2 sentence (Vx)(3y)^(x, y) £ T. Suppose a G V, where |a| = 
|x|. If possibility (%) of Definition 3.8 holds, then there is an internal witness for 
(3y)ip(a, y), i.e., some b G a such that V \= ip(a, b). Otherwise, possibility (ii) holds, 
and so the set {b G V : V \= ip(a.,b)} of external witnesses has positive m- measure 
for an arbitrary nondegenerate probability measure m on M; in particular this set 
is nonempty. Either way, for all a G V we have V |= (3y)^(a, y), and therefore 
V |= (Vx)(3y)^(x, y). Thus V |= T. □ 
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Furthermore, when m is continuous, we can sample from V to obtain a random 
structure that is a model of T almost surely. 

Theorem 3.10. Let T be a countable pithy II2 theory of C Ult u(L), and let V be a 
Borel L-structure. Suppose m is a continuous probability measure on R such that 
(V,m) witnesses T. Then fJ-r-p jm ) is concentrated on the set of structures in Sl that 
are models ofT. 

Proof. Let A = (aj)i g£J be an m-i.i.d. sequence of elements of V . Recall that ^(v,m) 
is the distribution of the random structure J--p(A), and so we must show that 
F-p{A) |= T a.s. Because T is countable, it suffices by countable additivity to 
show that for any sentence ip G T, we have J--p(A) |= ip a.s. 

Recall that T is a countable pithy II2 theory. Suppose (Vx)(3y)^(x, y) G T, where 
|x| = k (possibly equal to 0). Our task is to show that, with probability one, 

JHA) |=(Vx)(3y)^(x,y). 

Fix t\ ■ ■ ■ ife G N. We will show that, with probability one, 

T v (A)\=(3y)ij(t 1 ---t k , y ). (f) 

Consider the random tuple a% x ■ ■ ■ at k ■ Because V strongly witnesses T, by Defini- 
tion 3.8 it is surely the case that either 

(i) for some t such that 1 < I < k, the random real at e is an internal witness 
for (3y)^(a tl ■ ■■<H k ,y), i.e., 

V |= ip(a tl ■ ■ ■ a tk ,a te ), 

or else 

(ii) the (random) set of witnesses for (3y)tb(at 1 • ■ -at k ,y) has positive measure, 
i.e., 

m({b£R : V \=ip(a tl ---at k ,b)}) > 0. 

In case (i), we have 

F V {A) |= ih(t x - ■■tfott), 

where £ is as above, and so (f) holds surely. 

Now suppose case (ii) holds, and condition on at 1 ■ ■ ■ a tk . Then 

(3 := m({b £ R : V |= ip(a tl ■ ■ ■ <H k , b)}) 

is a positive constant. For each n G N not among tx,...,tk, the random element a n 
is m-distributed, and so the events 

V |= ip(a tl ■ ■■a tk ,a n ) 

each have probability f3. These events are also mutually independent for such n, 
and so with probability one, there is some s G N for which 

F V {A) \=rp(tf-t k ,s). 

Therefore, in this case, (f ) holds almost surely. □ 

Finally, we show that given a Borel L-structure strongly witnessing T, we can 
construct an invariant measure concentrated on the countable models of T. 
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Corollary 3.11. Let T be a countable pithy U2 theory of C wltW (L), and let V be a 
Borel L-structure that strongly witnesses T . Then there is an invariant measure on 
Sl that is concentrated on the set of structures in Sl that are models ofT. 

Proof. Let m be a nondegenerate probability measure on R that is continuous (e.g., a 
Gaussian or Cauchy distribution). By Theorem 3.10, H(-p,m) is an invariant measure 
concentrated on the set of structures in Sl that are models of T. □ 

Our constructions of invariant measures all employ Borel L-structures V that 
strongly witness T. We note that the machinery developed in §3.2 could have been 
used to build invariant measures via the substantially weaker condition that (V, m) 
witness each sentence of T only for m-almost all tuples a. However, in this case, V 
need not be a model of T (in contrast to Lemma 3.9), nor need (V, m) even witness 
T. Also, while we defined the notion of witnessing only for structures on M, we 
could have developed a similar theory for L-structures whose underlying set is an 
m-measure one subset of R. 

Next we find conditions that allow us to construct Borel L-structures that strongly 
witness T. When T is the pithy II2 expansion of the Scott sentence of a particu- 
lar countable infinite L-structure Ai, we will thereby obtain an invariant measure 
concentrated on M. 

3.3. Duplication of quantifier-free types. 

We now introduce the notion of a theory having duplication of quantifier-free 
types. We will see in §3.4 that when L is a countable relational language and 
T is a countable pithy 1I2 theory of £ Wlj£i ,(L), duplication of quantifier- free types 
guarantees the existence of a Borel L-structure strongly witnessing T. However, for 
the definitions and results in §3.3, we do not require L to be relational. 

We first recall the notion of a quantifier-free type, which can be thought of as 
giving the full description of a particular configuration of relations that could hold 
among the elements of some tuple. In first-order logic this is typically achieved 
with an infinite consistent set of sentences, but in our infinitary context, a single 
satisfiable sentence of C Ul ^{L) suffices. 

Suppose x is a finite tuple of variables. Define a (complete) quantifier-free 
type p(x) of C wutl3 {L) to be a quantifier- free formula in £ Wl)U ,(L), whose free vari- 
ables are precisely those in x, such that the sentence (3x)p(x) has a model, and 
such that for every quantifier-free formula <^( x ) G C LOl:U} {L), either 

|= p(x) — > tp(x) or |= p(x) — > -i(/?(x). 

Because we require this only for quantifier-free formulas <p, it suffices for p(x) to be 
a quantifier-free formula such that whenever R is either a relation symbol from L 
or the equality symbol, and whenever y is a tuple of the arity of R such that every 
variable of y is in the tuple x, either 

H p( x ) -> R(y) ° r 1= p( x ) -»■ ->-R(y)- 

By taking countable conjunctions, we see that every tuple in every L-structure 
satisfies some complete quantifier- free type in the above sense. This justifies our use 
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of the word type for a single formula rather than for a collection of formulas, as is 
more standard. 

We will often call complete quantifier- free types of jW (L) simply quantifier-free 
types, and sometimes refer to them as quantifier-free C wliW (L) -types. Although we 
have required that a quantifier-free type p(x) have free variables precisely those in x, 
when there is little possibility of confusion we will sometimes omit the entire tuple 
x and refer to the type as p. 

We say that a quantifier-free type p(x) is consistent with T when TU (3x)p(x) 
has a model. A tuple a in an L-structure A4, where |a| = |x|, is said to realize 
the quantifier- free type p(x) when Ai |= p(a); in this case we say that p(x) is the 
quantifier- free type of a (as it is unique up to equivalence). 

Suppose that p(x) and q(y) are quantifier- free types, where y is a tuple of variables 
containing those in x. We say that q extends p, or that p is the restriction of q 
to x, when |= q(y) — > p(x). 

Definition 3.12. A quantifier-free type p(x%, . . . , x n ) is said to be non-redundant 

when it implies the formula Ai<i<j< n ( x i ^ x j)- 

Note that every quantifier-free type is equivalent to the conjunction of a non- 
redundant quantifier-free type and equalities of variables, as follows. Suppose q is a 
quantifier- free type. Let S be the set containing those formulas (u = v), for u and 
v free variables of q, such that q implies (u = v). Then q is equivalent to 

r A /\ C 

for some non-redundant quantifier- free type r. 

The following notion will be used in the stages of Construction 3.17 that we call 
"refinement" . 

Definition 3.13. We say that T has duplication of quantifier-free types when, 
for every non-redundant quantifier-free type p(x, z) consistent with T, there is a non- 
redundant quantifier-free type q(x, y, z) consistent with T such that 

1= q(x, y, z) -> (p(x, z) A p(y, z)) , 

where p(y, z) denotes the type p(x, z) with all instances of the variable x replaced 
by the variable y. 

In other words, when T does not have duplication of quantifier-free types, then 
there is some non-redundant quantifier-free type p(x, z) consistent with T and some 
model M of T containing a tuple (a, b) realizing p such that the only way for a 
tuple of the form (a', b) to also realize p is for a' to equal a, i.e., the type of (a, a', b) 
must be redundant. 

3.4. Construction of a Borel L-structure strongly witnessing T. 

Let L be a countable relational language, and let T be a countable pithy LT2 
theory of Coj 1iUI (L) that has duplication of quantifier- free types. We now construct 
a Borel L-structure V that strongly witnesses T . This construction is inspired by 
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[PV10, Theorem 5], in which Petrov and Vershik build an analogous continuum- 
sized structure realizing the theory of the Henson graph J^. We begin with an 
informal description. 

We will construct V by assigning, for every increasing tuple of reals, the quantifier- 
free type that it realizes. This will determine the quantifier-free type of every tuple 
of reals, and hence determine the structure V on K, as we now explain. 

Definition 3.14. Given (strictly) increasing tuples of reals c and d, we say that 
c separates d when every left-half-open interval whose endpoints are consecutive 
entries of d contains exactly one entry of c, i.e., for < j < I, 

Cj £ (dj,d j+1 ], 

where c = co • • • cg-\ and d = do ■ ■ ■ dg. 

For example, the pair 23 separates the triple 125. 

Let c be an arbitrary tuple of reals (not necessarily in increasing order, and 
possibly with repetition). We write to denote the increasing tuple that consists 
of precisely the same reals. For example, 2215^ = 125. The quantifier-free type of 
an arbitrary tuple c is determined by the quantifier-free type of along with the 
relative ordering of the entries of c. For example, let p(xyz) be the quantifier-free 
type of 125. Then the quantifier-free type of 2215 is the unique (up to equivalence) 
formula q{ywxz) implied by p{xyz) A (y = w). Hence in order to determine the 
quantifier-free type of every tuple of reals, and thereby define a structure V on R, 
it suffices to assign the quantifier-free types of all increasing tuples. 

In Construction 3.17, we will build our Borel L-structure V inductively, making 
sure that V strongly witnesses T. At stage i > of the construction we will define 
the following quantities: 

• Ti = (r l , . . . , rfi _ 1 ), the increasing tuple of all rationals mentioned by the 
end of stage i; 

■ pi, the quantifier- free type of r^; and 

• Vj = (vq, . . . , vf r <), an increasing tuple of irrationals separated by r^. 
We call the left-half-open intervals 

(-00,4], (4,4], •••> (4,1-1' 4-J> Wril'°°) 
the intervals determined by v^. 

We will define the Vj so that they form a nested sequence of tuples of irrationals 
such that every (increasing) tuple that separates a given Vj, including rj, is assigned 
the same quantifier-free type pi at stage i. The sequence of tuples {vj}j ew will be 
such that the set of reals Uje^ v j ^ s dense in R. Thus for every tuple of reals a, 
all of its entries occur in some increasing tuple that separates Vj for some i, and 
so its quantifier-free type will eventually be defined. This motivates the following 
definitions. 

Definition 3.15. For each stage i, define Bi to be the set of tuples c G M such 
that there is some increasing tuple del that contains every entry of c and that 
separates v». 
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Note that Bi C B^ for i < i' , and that Ujew^j contains every tuple of reals. 

By the end of stage i, we will have defined the quantifier- free type of every tuple 
that separates Vj, and hence by extension, of every tuple in B%. For example, if 
125 £ Bi, then 2215 6 Bi also, and by the end of stage i the quantifier-free type of 
125 will be determined explicitly, and of 2215 implicitly, as described above. 

Next we define an equivalence relation on Bi, which we call i-equivalence. By the 
end of stage i, tuples in Bi that are i-equivalent will have been assigned the same 
quantifier-free type. 

Definition 3.16. Let i > 0. We say that two tuples c, d £ Bi of the same length I 
are i-equivalent, denoted c ~j d, if for all j < t, the jth entry of c and jth entry 
of d both fall into the same interval determined by Vj. Any two elements of Bi of 
different lengths are not i-equivalent. 

For example, each left-half-open interval (Vj,Vj +1 ] determined by Vj, where 
< j < |rj|, is the z-equivalence class of any element in the interval. 

Note that for i' > i, the notion of z'-equivalence refines i-equivalence on the set 
Bi. Furthermore, our construction will be such that for any two distinct i-equivalent 
tuples in Bi, there is some %' > % for which they are not i'-equivalent. 

In the construction, we will assign quantifier-free types in such a way that V 
strongly witnesses T. Specifically, for every a £ V and every pithy II2 sentence 
(Vx)(3y) , 0(x, y) £ T, if there is no internal witness for (3y)ip(a,y), then at some 
stage i we will build a left-half-open interval / of i-equivalent elements all of which 
are external witnesses for (3y)ip(a,y). This will imply that for any c ~j a, every 
b € I will witness (3y)^(c, y), since ab ~j cb and i-equivalent tuples realize the same 
quantifier-free type. 

We will build these external witnesses in the even-numbered stages of the con- 
struction; we call this process enlargement, because we extend the portion of the 
real line to which we assign quantifier-free types. In the odd-numbered stages, we 
perform refinement of intervals, so that distinct i-equivalent tuples in V are eventu- 
ally not z'-equivalent for some i' > i; this ensures that each expression (3y)ip(a, y) 
will be realized with respect to all possible a £ V . In fact, as we have noted earlier, 
by the end of every stage i, we will have assigned the quantifier- free type of every 
tuple in Bi in such a way that i-equivalent tuples have the same quantifier-free type. 

Construction 3.17. Fix an enumeration {(pi}i £uj of the sentences of T such that every 
sentence of T appears infinitely often. Because T is a pithy H2 theory, for each i, 
the sentence <pi is of the form 

(Vx)(3y)^i(x, y), 

where ipi is a quantifier-free formula whose free variables are precisely xy, all distinct, 
and where x is possibly empty. Consider the induced enumeration {^}j gaj , and for 
each i, let ki be one less than the arity of ipi. Also fix an enumeration {qi}^^ of the 
rationals. 

We now give the inductive construction. For a diagram, see Figure 1. The key 
inductive property is that at the end of each stage i, the quantifier-free type pi is 
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consistent with T, extends (f° r * > 1)) and is the (non-redundant) quantifier- 
free type of every tuple that separates Vj, including r^. 

Stage 0: Set ro to be the tuple (0), let po be any quantifier- free unary type consistent 
with T, and set vo to be the pair (— y/2, \/2). 

Stage 2i + 1 (Refinement): In stage 2i + 1, we will construct a tuple r2«+i of 
rationals, a tuple \~2i+i of irrationals, and a non-redundant quantifier-free type P21+1 
consistent with T in such a way that these extend r2i, V2i, and p2i, respectively. In 
doing so, we will refine the intervals determined by \2i, and assign the quantifier- 
free type of every increasing tuple that separates V2i+i- By extension, this will 
determine the quantifier-free type of every tuple in Z?2i+i, i.e., of every tuple c all of 
whose entries are contained in some tuple that separates V2i+i, in such a way that 
(2i + l)-equivalent tuples are assigned the same quantifier-free type. 

Define r2i+i to be the increasing tuple consisting of the rationals r2i U 

We need to define the quantifier- free type P2i+i of r2«+i so that it extends p2i, 
the quantifier- free type of T2i- There are three cases, based on the value of q-i. 

Case 1: The "new" rational qi is already an element of T?2i- In this case, there is 
nothing to be done, as Y2i+\ = r2j, and so we set P2i+i '■ = P2i- 

Case 2: We have % € (— oo,Vq 1 ] U (u? 1 ,,oo), i.e., the singleton tuple (qi) is 

not in B2i- If qi < Vq" 1 , let p2i+i(xo,. . . ,x\ T2 .\) be any non-redundant quantifier- 
free type consistent with T that implies P2i{x\, . . . ,x\ r2 .\). Similarly, if qi > fj^ 2 .|j 
let p2i+i(^o> • • • i x \r 2t \) b e such that it implies P2i(xo, . . . , ari r2i i_i). Such quantifier- 
free types P21+1 must exist, because p2% is consistent with T and we have not yet 
determined the set of relations that hold of any tuple that has an entry lying outside 
the interval ( v o\ v fr 2i \\- 

Case 3: Otherwise. Namely, qi G (Vj' t ,Vj l +1 ] for some j such that < j < | r 2i | ? 
and % / r| l . Note that the tuples 

2i 2i j 2i 2? 2i 2i 

r o • • • r| raihl and r • • • q t r j+1 ■ ■ ■ 

both separate Vj, and hence by our construction, satisfy the same quantifier- free 
type p2i- By our assumption that T has duplication of quantifier- free types, and 
because p2% is non-redundant, there must be a non- redundant quantifier- free type 
P2i+i(xo, ■ ■ ■ > x \r 2 i\) consistent with T that implies 

P2i(x , . . .,Xj,Xj +2 ,.. -,X\ T2i \) f\p 2 i(x 0l . . ^Xj-uXj+i, . . . ,Z| r2i |). 

Whichever case holds, now let V2i+i be any increasing tuple of irrationals that 
contains every entry of V2i and is separated by ^j+i. Consider the subtuple of 
variables z C a;o ■ ■ ■ aJi r2i i that corresponds to the positions of the entries of r2i 
within T2i+i- In each case above, P2i+i(^o • ■ ■ x |r 2i |) i s a non-redundant quantifier- 
free type consistent with T whose restriction to z is P2i(z). Hence we may assign the 
quantifier- free type of every increasing tuple that separates V2«+i (including r2«+i) 
to be p2i+i- By extension, this determines the quantifier-free type of every tuple in 

£>2i+l- 
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Stage 2i + 2 (Enlargement): 

In stage 2i + 2, we will construct a tuple r-2i+2 of rationals, a tuple \~2i+2 of 
irrationals, and a non-redundant quantifier-free type p2i+2 consistent with T in such 
a way that these extend r2«+i, V21+1, an d P2i+i, respectively. As we do so, we 
will enlarge the portion of the real line to which we assign quantifier-free types. 
At the end of the stage we will have determined the quantifier-free type of every 
tuple in £>2i+2, in such a way that (2z + 2)-equivalent tuples are assigned the same 
quantifier-free type. 

Our goal is to provide witnesses for (3y)tpi(a, y) , where Vi( x >2/) is from our 
enumeration above, for each fcj-tuple of reals a G £>2«+i 5 i-e., each fcj-tuple whose 
quantifier- free type is determined by P2i+i- We extend the non-redundant quantifier- 
free type P2i+i(xo • ■ ■ x \T2 i+1 \-i) t° a non-redundant quantifier-free type 
P2i+2(xo • • • x |r 2 i+i|-i) w ) so that for every such tuple a without an internal witness, 
there is an entry of w whose realizations provide external witnesses. 

Let {z^}i<£<iVi be an enumeration of all tuples of variables (possibly with repeti- 
tion) of length ki, every entry of which is among xq, . . . , £i r2i+1 |_i- We now define, 
by induction, intermediate non-redundant quantifier-free types 

{s £ (x ■ ■ ■ X| r2i+1 |-l, Ue)}o<g< Ni 

consistent with T such that S£ + i implies S£ for < £ < N{. As we step through 
the tuples of variables of length ki, if we have already provided a "witness" for 
(3y)ipi(zg + i, y) then we do nothing; otherwise, we extend our quantifier-free type to 
provide one. 

Let so := P2i+i, and let uo be the empty tuple of variables. Now consider step 
£ < Ni of the induction, so that sq,. . . ,sg have been defined. If there is a vari- 
able t among Xq ■ ■ ■ S| r2 . +1 |_ 1 or among such that sh(xq ■ ■ ■ X| r2 . +1 |_i, u^) implies 
ipi(z£ + i,t), then let se + \ := S£ and u^ + i := u^. If not, then because se is consistent 
with T and (Vx)(3y)^(x, y) G T, there must be some non-redundant quantifier-free 
type s^+i consistent with T that has one more variable, W£+i, than S£, such that 
S£ + i implies both sg and ipi(zi + i,we + i); in this case, let u^ + i := \i£W£ + \. Let 

P2i+2{XQ ■ ■ ■ S|r 2i+1 |-l, W) := SjVi(so " " " ^|r 2l+1 1-1 , w) , 

where w := u^. Note that ^21+2(^0 ■ ■ ■ x |r 24+ i|-i5 w ) ^ a non-redundant quantifier- 
free type that is consistent with T and extends P2i+i{x® ■ ■ ■ ^|r 2i+ i|-i)- 

Next, choose |w|-many rationals greater than all elements of r2i+i, and define 
f2i+2 to be the increasing tuple consisting of r2i+i and these new rationals. Let 
v 2i+2 be an arbitrary increasing tuple of irrationals that contains every entry of 
V2«+i and is separated by r2i+2- Finally, for every increasing tuple that separates 
V2«+2 (including ^+2), declare its quantifier- free type to be p2i+2- As with the 
refinement stages, this determines by extension the quantifier-free type of every 
tuple in ,621+2, i-e., of every tuple c all of whose entries are contained in some tuple 
that separates V2i+2- In particular, for any tuple a G ^2«+i of length ki such that 
(3y)ipi(a. 1 y) does not have internal witnesses, we have constructed a left-half-open 
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interval {v 2t+2 ,v 2l _^~ 2 ], for some j such that < j < | r 2*4-2 1 ; consisting of external 
witnesses for (3y)ipi(a, y). This ends the stage, and the construction. □ 



(a.) 
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Figure 1. An illustration of Construction 3.17. 
(a) Suppose that we start stage 2i + 1 with the tuple Y2i 



\rl\rl\ 



"2") of rationals and the tuple V2« 



\vl\vf,vf,vf 



) of 



irrationals. 

(b) Suppose that the rational qi falls between v 2i and r|*. 

(c) By the end of stage 2i + 1, the rational qi has become r 2 l+ , and 
the rationals and irrationals to its right are reindexed. 

(d) Suppose that in stage 2i + 2 we need two intervals of external 
witnesses for (3y)^j(a, y) as a ranges among fcj-tuples all of whose 
entries are entries of Y2i+\. Then we select two new rational witnesses 



„2i+2 



and r^ +2 to the right of V2i+i. 



(e) At the end of stage 2i + 2, we choose irrational interval boundaries 



,2i+2 



(between rf +2 and r| l+2 ) 



and vf +2 



(to the right of r 



2i+2^ 
5 



We now verify that this construction produces a structure with the desired prop- 
erties. 
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Theorem 3.18. Let T be a countable pithy U2 theory of C uliUJ (L) that has dupli- 
cation of quantifier-free types, and let V be the L-structure obtained via Construc- 
tion 3.17. Then V is a Borel L-structure that strongly witnesses T. 

Proof. We first show that V is a Borel L-structure. Fix a relation symbol R G L, 
and let k be the arity of R. We must show that {a G V k : V \= -R(a)} is Borel. For 
each i > define 

Xi := {a G V k : V |= R(a) and a G Bi}. 
Recall that by our construction, the set of reals Ujew v j * s dense in M, and so every 
tuple of reals is in \Jj &LJ Therefore 

{aGP fe :?H«(a)}=U jeu 4 

In particular, it suffices to show that Xi is Borel for each i. 

Fix some i > 0, and note that for every a, a' G Bi such that a ~j a', we have 

V \= R(a) if and only if V |= i?(a'), 

because i-equivalent tuples are assigned the same quantifier-free type. Furthermore, 
for every a G Bi, the set 

{c G Bi : c ~j a} 

is a /c-fold product of left-half-open intervals. Hence Xi is Borel, and so V is a Borel 
L-structure. 

We now show that V strongly witnesses T. Let m be an arbitrary nondegenerate 
probability measure on R. Consider a pithy II2 extension axiom 

(Vx)(3y)£(x,y)GT, 

and let a be a tuple of reals such that |a| = |x|, where |x| could possibly be zero. 

Suppose (3y)£(a, y) does not have an internal witness. Let £* be the least stage 
such that a G ^2^*4-1. Because each sentence of T appears infinitely often in the 
enumeration {ipj}j &u) , there is some t > £* such that (pi = (Vx)(3y)£(x, y), and 
hence such that ^ = ipe- 

Since a G #2^+1, at stage 21 + 2 there is some real b such that "P |= ?pi(a,b). 
Furthermore, we have ensured that there is a left-half-open interval of reals b' such 
that b' ~2^+2 b and hence V \= ipi{a, b'). Because m is nondegenerate, the collection 
of external witnesses for (3y)£(a, y) has positive m-measure. Hence (V, m) witnesses 
T. As m was an arbitrary nondegenerate probability measure, V strongly witnesses 
T, as desired. □ 

3.5. Invariant measures from trivial definable closure. 

We are now ready to prove the positive direction of the main theorem for count- 
able relational languages. We have seen that if a countable pithy n2 theory T has 
duplication of quantifier- free types, then there exists a Borel L-structure strongly 
witnessing T. In the case where T has a unique countable model M up to iso- 
morphism (including our situation, where T implies the Scott sentence of du- 
plication of quantifier-free types is moreover implied by M having trivial definable 
closure. We will later see, in Corollary 5.3, a partial converse to this result. 
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Lemma 3.19. Let L be a countable language (not necessarily relational), and let T 
be a countable theory of C Ul)U (L) such that every countable model of T has trivial 
definable closure. Then T has duplication of quantifier-free types. 

Proof. Let A be a countable fragment of C Wl ^ w (L) such that T C A and let Ta be 
the pithy H2 expansion of T to A, as described in Definition 2.10. Suppose p(xz) 
is a non-redundant quantifier-free £ U)ljU] (L)-type consistent with T. It follows from 
Lemma 2.11 that there is a (unique) non-redundant quantifier-free C wl>w (LA)-type 
Pa(xz) consistent with Ta such that 

|= pa(xz) ->■ p(xz). 

The Downward Lowenheim-Skolem theorem for C Wl)W (L) [KK04, Theorem 1.5.4] 
then implies that there must be a countable model Ma of Ta and a tuple 6a € Ma 
that realizes pa(xz), i.e., Ma |= Pa (6a). Every countable model of T has trivial 
definable closure, and so every countable model of Ta also has trivial definable 
closure, by Lemmas 2.11 and 2.13. In particular, Ma has trivial definable closure. 
Because pa(xz) is non-redundant, 6 a, and so 6 dcLvt A (a). Hence there is 
an automorphism r of Ma such that r(a) = a but t(6) 7^ 6. This implies that 
if qA{xyz) is the non-redundant quantifier-free (La) -type of the tuple r(6)6a, 
then 

H qA{xyz) -f (pa{xz) Ap A (yz)). 

Hence T4 has duplication of quantifier-free types. Let q(xyz) be the unique quantifier- 
free jW (L)-type consistent with T such that 

1= qA(xyz) <?(xyz), 

and note that p(xz) and p(yz) are quantifier- free C LUltLU (L)-types consistent with T. 
It is then immediate that 

H g(^yz) -> (p(ajz) Ap(yz)), 
and so T has duplication of quantifier-free types as well. □ 

We now use Theorem 3.18 and Lemma 3.19 to prove Theorem 3.20. Although 
Lemma 3.19 does not require the countable language L to be relational, Theo- 
rem 3.18 does, and so Theorem 3.20 requires L to be relational as well. However, 
as we will see in the next section, Theorem 3.20 generalizes to arbitrary countable 
languages, thereby providing one direction of our main result, Theorem 1.1. 

Theorem 3.20. Let L be a countable relational language, and let M be a countable 
infinite L-structure. Lf M has trivial definable closure, then there is an invariant 
probability measure fi on Sl that is concentrated on M. 

Proof. Let o_m G C Wi ,uj(L) be the Scott sentence of M, and let T := {ctm}i so that 
every countable model of T is isomorphic to M. Let A be a countable fragment 
of Cu lt w(L), with o~m £ A, and let Ta be the pithy II2 expansion of T to A, as in 
Definition 2.10. Recall that Ta is countable. By Lemma 3.19, Ta has duplication 
of quantifier-free types. So by Theorem 3.18, there exists a Borel L^-structure Va 



INVARIANT MEASURES CONCENTRATED ON COUNTABLE STRUCTURES 



31 



strongly witnessing Ta- By Corollary 3.11 there is an invariant probability measure 
HA on Sl a that is concentrated on models of Ta- 

Since La enlarges L, the map that takes an L^-structure to its L-reduct is a 
projection map between Sl a and Sl, hence is measurable. In particular, every 
invariant measure on Sl a induces an invariant measure on Sl- Therefore, the 
measure ha induces an invariant probability measure /i on Sl that is concentrated 
on those structures in Sl that are models of T and have an expansion to a model of 
Ta- But by construction, M. is the only countable L-structure, up to isomorphism, 
that has an expansion to a model of Ta- Hence /x is concentrated on jVf. □ 

Although the proof of Theorem 3.20 produces a Borel L^-structure, where La 
contains, for each finite arity k, infinitely many fc-ary relation symbols not in L, we 
can obtain the same invariant measure via a Borel L-structure. 

Corollary 3.21. Let L be a countable relational language, and let Ai be a countable 
infinite L-structure. If Ai has trivial definable closure, then there is a Borel L- 
structure V such that for any continuous nondegenerate probability measure m on 
R, the invariant measure H(v,m) i> s concentrated on Ai . 

Proof. Let T, A, La, Ta, and Va be as in the proof of Theorem 3.20. Define V 
to be the reduct of Va to L, and let m be an arbitrary continuous nondegenerate 
probability measure on M.. Note that for any relation R G L and any tuple of natural 
numbers m, . . . , n k , where k is the arity of R, we have 

V(V,m)(R(ni, ■ ■ -,n k )) = H(v A , m ){R{ni, - - -,n k )). 

Hence fJ>CP,m) 1S the measure obtained by projecting the measure H(V A ,m) to Sl- By 
the proof of Theorem 3.20, the measure H(v A ,m) is concentrated on models of Ta- 
Because Ta is a conservative extension of T, the measure H(v,m) ^ s concentrated on 
models of T. Hence H(V,m) ls concentrated on M. □ 

We now consider the case where the countable language L is not necessarily 
relational. 

4. Existence of invariant measures (arbitrary languages) 

In Section 3 we proved Theorem 3.20, the positive direction of the main theorem 
for countable relational languages. In this section we show that the generalization 
of Theorem 3.20 to arbitrary countable languages holds as well, essentially because 
both definable closure and the existence or non-existence of invariant measures are 
preserved under the standard translation of an arbitrary language to a relational 
one. For completeness, we describe this translation below. 

Let I = KUCUJbea countable language with 1Z a set of relation symbols, 
C a set of constant symbols, and J- a set of function symbols. We will define a 
new relational language L* corresponding to L, by replacing each n-ary function 
symbol of L with a new (n + l)-ary relation symbol corresponding to the graph 
of the function, and each constant symbol of L (which can be considered to be a 
0-ary function symbol) with a new unary relation symbol whose interpretation will 
contain precisely the element labeled by the constant symbol. 
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Define the relational language L* := 1Z U C* U T* where C* = {c*(x) : c G C} 
and J 7 * = {/*(x, y) : /(x) € J 7 } are sets of new relation symbols of the appropriate 
arities. Let D be the following collection of sentences: 

• (3y)c*(y), 

• (Vy,y')(c*(y)Ac*(y')^( y = y')), 

• (Vx)(3y)/*(x,y), and 

• (Vx, y, y') (/* (x, y) A /* (x, y') -> (y = y')) , 

where c G C and / G J 7 . 

For each L-formula, we now describe the corresponding L*-formula. First, for 
each L-term t(x), where the free variables of t are among x, inductively define the 
L*-formula t* (x, y) as follows. For each variable x, set x* to be x itself. Now consider 

i(x) = n(si(x), s 2 (x), . . . , s n (x)), 

where u G C U J 7 and the terms si(x), . . . , s n (x) correspond to the L* -formulas 
sl(x,Z! ),..., s*(x,z n ). Define 

i*(x,y) := (3zi,...,z n )u*(zi,...,2; n ,y) A Ai< n <(x,2;i). 

Next, for each L-formula v?(x), inductively define the L* -formula </?*(x), having the 
same free variables as <p(x), as follows. 

• If ii(x), . . . , i m (x) are L-terms and R G 1Z is an m-ary relation, then 
i?*(ti(x), . . . ,t m (x)) := (3zi, . . . ,z m )R*(z 1 , .. . ,z m ) A Aj< m **(x,^); 

• if ti(x), t2(x) are L-terms, then (ii(x) := t2(x))* := (3z) (ii(x, z) At*,(x, z)) ; 

• (Aie/¥>( x ))* : = A ie /V?*(x); 

• (^( x ))* : = ^^*( x ); and 

• ((VyMx,y))*:=(Vy)^*(x,y). 

Note that under this translation, a sentence ip G C Wl)W (L) corresponds to the 
sentence ip* G C ulljUJ (L*). Finally, given a theory T of £ WljW (L), define T* to be the 
theory {ip* : <p £ T} of C UlJU (L*). 

Let (Sl)* be the collection of L* -structures with underlying set N that satisfy D. 
There is a natural bijection a : Sl — > (Sl)* under which relations stay the same, 
and functions (including constants) map to their graphs. Furthermore, a has the 
following property. 

Lemma 4.1. The map a : Sl — > (Sl)* is such that for every formula (p G C uljU (L) 
and every structure M. G Sl, we have 

M |= ip(n 1 , . . .,nj) 

if and only if 

a(M) |= <p*(ni, . . .,nj). 



INVARIANT MEASURES CONCENTRATED ON COUNTABLE STRUCTURES 



33 



It follows that the map a preserves definable closure and induces a correspondence 
between invariant measures on Sl and those on (Sl)* ■ In particular, we have the 
following corollaries. 

Corollary 4.2. Let Ai £ Sl- For every tuplea E N, we have dcLvi (a) = dcl a (^)(a). 

Corollary 4.3. Let T be a theory of C U1 ^(L). Then there is an invariant measure 
concentrated on those L-structures that satisfy T if and only if there is an invariant 
measure concentrated on those L* -structures that satisfy T* U D. 

Corollaries 4.2 and 4.3 allow us to show the generalization of Theorem 3.20 to 
arbitrary countable languages. 

Theorem 4.4. Let L be an arbitrary countable language, and let Ai be a countable 
infinite L-structure. If Ai has trivial definable closure, then there is an invariant 
probability measure fi on Sl that is concentrated on Ai. 

Proof. Let Ta be the pithy LI2 expansion of the theory consisting of the Scott sen- 
tence of Ai. By Corollary 4.2 we may continue as in the proof of Theorem 3.20, but 
with the theory (Ta)* U D replacing Ta, to produce an invariant measure on (Sl)* 
concentrated on the unique (up to isomorphism) countable model of (Ta)* U D. 
But then by Corollary 4.3, we obtain an invariant measure concentrated on the 
unique (up to isomorphism) countable model of Ta, and the second paragraph of 
the proof of Theorem 3.20 goes through unmodified. Hence this invariant measure 
is concentrated on Ai. □ 

5. NON-EXISTENCE OF INVARIANT MEASURES 

We now prove the converse of Theorem 4.4. This tells us that for any countable 
language L, a countable infinite L-structure that has nontrivial definable closure 
cannot admit an invariant measure. 

In earlier sections we worked with quantifier-free types; in the theorem below we 
use full types that consist of arbitrary formulas. Define a type p(x) of C ulljUJ (L) to 
be a formula in LZ Ul)UJ (L), whose free variables are precisely those in x, such that 
(3x)p(x) has a model, and for every formula </?(x) € C UltW (L), either 

|= p(x) — > (f(x) or |= p(x) — > -itp(x). 

As before, a tuple a (with |a| = |x|) in an L-structure Ai is said to realize the type 
p(x) when Ai |= p(a); in this case we say that p(x) is the £ wl)CJ (L)-type of a. 

An £ Wl>CJ (L) type is usually taken to be the collection of all £ wl;a; (L)-formulas 
that are satisfied by a tuple in some L-structure. However, the definition above 
suffices for our purposes, because we are working with theories that have only one 
countable model (up to isomorphism), and so every type is principal, i.e., generated 
by a single formula. 

The basic intuition of the argument is simplest to describe in the case where 
the language L contains a constant symbol. Let c be some constant symbol in L. 
By invariance, the probability that c is assigned to the natural number in the 
underlying set must be the same as the probability that c is assigned to 1 , or to any 
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other particular natural number. But because in any structure in Sl, the constant 
symbol c is assigned to precisely one natural number, these probabilities must sum 
to unity, a contradiction. 

In fact, for a structure Ai G Sl, any element b G dcLvf (0) poses a similar problem, 
as any element of Sl that is isomorphic to Ai must realize the type of b exactly 
once. 

More generally, an element definable over a tuple is similarly problematic. In 
the full setting, the argument proceeds roughly as follows. Suppose a, b G Ai with 
b G dcLvi(a) — a. Let p(x) be the type of a in Ai. By invariance, the infinitely 
many possible assignments to x in p{x) are equally likely. Because p is realized in 
Ai, one such assignment must occur, and so the probability that an arbitrary tuple 
of N (of the appropriate length) satisfies p(x) is positive. Now, the type q(xy) of ab 
in Ai may have many realizations in Ai, but since b G dcLvi(a), for any particular 
instantiation £ of p(x), there can be only one realization of q(£y). By invariance, 
the infinitely many possible assignments to y in q{£y) are equally likely, and because 
b G dcLvj(a), these assignments are independent events. But one such assignment 
must occur, because Ai realizes the type q, which leads to a contradiction. 

In the next theorem we make this argument precise. In the proof we will need the 
standard model-theoretic fact that in a countable L-structure Ai, if two tuples in 
Ai of the same length have the same C Wl ^(L)-type, then there is an automorphism 
of Ai taking one tuple to the other (see [KK04, Theorem 3.3.5]). 

Theorem 5.1. Let L be an arbitrary countable language, and let Ai be a countable 
infinite L-structure. If there is an invariant probability measure p on Sl that is 
concentrated on Ai, then Ai must have trivial definable closure. 

Proof. Without loss of generality, we may assume that Ai G Sl- Suppose, for a 
contradiction, that there is a tuple a G Ai with distinct entries, and there is an 
element b G Ai, such that b G dcLvf (a) — a. Let j + 1 = |a|, and define p to be the 
£ui 1 ,u>(L)-type of a, and q to be the C UltUJ (L)-type of a&. 

Let a := /u(p(0 • • ■ j)). Because a G Ai, the type p(x) is realized in Ai, i.e., 

Ai |= (3x)p(x). 

Since the measure fi is concentrated on Ai, hence on L-structures that satisfy 
(3x)p(x), we have 

A*((=te)p(x)) = 1. 

Suppose a = 0. Then by the invariance of /j,, for any (j + l)-tuple of distinct 
natural numbers £ we have fj,(p(£)) = a = 0, and so by countable additivity, 

/i((3x)p(x)) = 0, a contradiction. Hence a > 0. 

Because ab realizes the type q(xy) in Ai, the type p(x) of a includes the sentence 
(3y)q(x.y). In particular, 

M \=p(0---j) (3y)q(0---jy). 
Since /i is concentrated on A4, we have 

/^((3y)<?(0 • • • jyj) = m(F(0- • -j)) = ol. 
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Now let P := fJ*(q(0 ■ ■ ■ j + 1)) . Because 

M |= (3xy)g(xy), 

we have 

/i((3xy)g(xy)) = 1. 

Again by invar iance of /i, for any k,k' > j we have 

I2(q(0---jk))= f i(q(0---jk'))=(3. 

Analogously to the previous argument, if f3 were equal to 0, we would obtain a 
contradiction by countable additivity. Hence /3 > 0. 

Finally, we use the fact that b G dcLvj(a) to derive the contradiction. Consider 
an arbitrary c £ M such that M. \= q(ac). Note that the £ Ul)U (L)-type of c over a 
is the same as that of b over a, and so there is an automorphism r of Ai such that 
r(ac) = ab. But since b G dcLvj(a), we must have c equal to b. Hence 

q(0---jk')nq(0---jk) = <D 

for k, k' > j where k ^ k' . But as 

lMq(0---jy) = \J k>j q(0---jk), 

we have, by the countable additivity of ^, that a = Y^k>j which is a contradiction 
as each of a and f3 are positive real numbers. □ 

This completes the proof of our main result, Theorem 1.1. Note that the proof of 
Theorem 5.1 shows directly that a probability measure concentrated on a structure 
with nontrivial definable closure cannot be invariant even under the action of the 
group Sym (N) of finite permutations of N. However, the ostensibly stronger claim 
of noninvariance under Sym (N) is in fact generally equivalent to noninvariance 
under the full group of permutations Sym(N), by the Kolmogorov extension theorem 
[Kal02, Theorem 6.16]. 

As an immediate corollary of Theorem 5.1, we see that any countable infinite 
L-structure admitting invariant measures cannot have constants, and all of its func- 
tions must be choice functions, or selectors. 

Corollary 5.2. Let L be an arbitrary countable language, and let Ai be a countable 
infinite L-structure. Suppose that either L has constant symbols or that there is a 
function symbol f G L and tuple a G Ai for which /(a) a. Then no invariant 
probability measure n on Sl can be concentrated on M.. 

Note that this implies that our characterization in Corollary 1.2 does not extend 
to structures with constants or functions, as demonstrated, e.g., by Hall's countable 
universal locally finite group, whose age has the strong amalgamation property 
[Hod93, §7.1, Example 1], but which does not have trivial definable closure in our 
sense. 

Finally, Theorem 5.1 has the following consequence, which extends Lemma 3.19 
on the relationship between trivial definable closure and duplication of quantifier- 
free types. 
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Corollary 5.3. Let T be a countable pithy U2 theory of C Ul)U {L) that has a unique 
countable model Ai (up to isomorphism). Then Ai has trivial definable closure if 
and only if T has duplication of quantifier-free types. 

Proof. From Lemma 3.19 it is immediate that if Ai has trivial definable closure then 
T must have duplication of quantifier-free types. 

For the other direction, suppose that T has duplication of quantifier-free types. 
By Theorem 3.18 there is a Borel L-structure strongly witnessing T, which by Corol- 
lary 3.11 induces an invariant probability measure concentrated on the models of T 
in Sl- Hence there is an invariant measure concentrated on Ai. But Theorem 5.1 
then implies that Ai has trivial definable closure. □ 

6. Examples 

We now consider specific countable infinite structures, and ask whether or not 
they admit invariant measures. In §6.1 we apply our main results, Theorem 1.1 
and Corollary 1.2, to examine certain well-known structures in relational languages. 
We make use of existing classifications to provide complete lists of countable infinite 
ultrahomogeneous permutations, partial orders, directed graphs, and graphs, as well 
as connected- homogeneous graphs, for which such invariant measures exist. In §6.2 
we consider countable infinite structures in languages with function and constant 
symbols, and in particular show that in the case of countable infinite commutative 
semigroups, there is a unique one (up to isomorphism) that admits an invariant 
measure. Finally, in §6.3, we show how any countable infinite structure is a quotient 
of one with trivial definable closure, and one without. We use this fact to construct 
countable structures of arbitrary Scott rank that have trivial definable closure and 
hence admit invariant measures, and to construct ones that do not. 

6.1. Structures in relational languages. 

Here we examine certain countable infinite structures in relational languages, 
and note whether or not they admit invariant measures. In some cases, such as 
the countable univeral ultrahomogeneous partial order, our results provide the first 
demonstration that the structure admits an invariant measure. In several instances, 
the existence of invariant measures was known previously, though our results provide 
a simple way to check this. For example, it has been known nearly since its initial 
construction that the Rado graph & admits an invariant measure, and Petrov and 
Vershik [PV10] constructed invariant measures concentrated on the Henson graph 
and on the other countable universal ultrahomogeneous iT n -free graphs. 

Our results may be used to determine whether a particular structure admits an 
invariant measure either by checking directly whether it has trivial definable closure 
and applying Theorem 1.1, or, in the case of an ultrahomogeneous structure, by 
determining whether its age has strong amalgamation and applying Corollary 1.2. 
It will be convenient sometimes to use the fact that a structure has trivial definable 
closure if and only if it has trivial algebraic closure, as mentioned in §2.4. 

In the examples below, all graphs, directed graphs, and partial orders are consid- 
ered to be structures in a language with a single binary relation symbol. 
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6.1.1. Countable infinite equivalence relations. 

Suppose a countable infinite structure A is the disjoint union of (finitely or in- 
finitely many) copies of a structure B. Then clearly A has trivial definable closure 
if and only if B does. Note that an equivalence relation is ultrahomogeneous if and 
only if it is the disjoint union of copies of a single equivalence class. Hence a count- 
able infinite set with an equivalence relation is ultrahomogeneous and has trivial 
definable closure if and only if either every equivalence class is infinite, or every 
finite equivalence class is a singleton and there are infinitely many such equivalence 
classes. Furthermore, if an equivalence relation has either a finite equivalence class 
of size at least two, or finitely many singleton classes, then it does not have triv- 
ial definable closure. Therefore the only countable infinite non-ultrahomogeneous 
equivalence relations with trivial definable closure are those that contain an infinite 
number of singleton equivalence classes along with at least one infinite equivalence 
class. 

6.1.2. Countable infinite linear orders. 

Suppose that X is a countable infinite linear order that has trivial definable 
closure. If X has a largest element, then this element is in the definable closure 
of the empty set, and similarly if X has a smallest element. Hence X cannot have 
endpoints. Furthermore, X must be dense, because given a,b £ X with a < b, if 
there is no c 6 X such that a < c < b, then b 6 dcl^(a). These two facts imply that 
X must be isomorphic to (Q, <), the unique countable dense linear order without 
endpoints. 

6.1.3. Countable infinite ultrahomogeneous permutations. 

Finite permutations have a useful interpretation as structures in a language with 
two binary relation symbols [Cam03] (see [Chell, §4.1] for a discussion). A permu- 
tation a on {1, . . . , n} can be viewed as two linear orders, < and -<, on {1, . . . , n}, 
where < is the usual order, and where -< is given by the permuted order, i.e., 
cr(a) -< o~(b) if and only if a < b. This view of permutations extends to infinite 
structures that consist of a single infinite set endowed with two linear orders; such 
structures describe relative finite rearrangements without completely determining a 
permutation on the set. The countable infinite ultrahomogeneous permutations, so 
defined, have been classified by Cameron [Cam03] as follows. 

(a) The rationals, i.e., where each linear order has order type Q and they are 
equal to each other. 

(b) The reversed rationals, i.e., where each linear order has order type Q and 
the second is the reverse of the first. 

(c) Rational blocks of reversed rationals, i.e., where each linear order is the 
lexicographic product of Q with itself, and the second order is the reverse of 
the first within each block. 

(d) Reversed rational blocks of rationals, i.e., where each linear order is the 
lexicographic product of Q with itself, and the second order is the reverse of 
the first between the blocks. 

(e) The countable universal ultrahomogeneous permutation. 
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All five have trivial definable closure and hence admit invariant measures. 

6.1.4. Countable infinite ultrahomogeneous partial orders. 
These have been classified by Schmerl [Sch79] as follows. 

(a) The rationals, (Q, <). 

(b) The countable universal ultrahomogeneous partial order. 

(c) The countable infinite antichain. 

(d) The antichain of n copies of Q (1 < n < uj). 

(e) The Q-chain of antichains, each of size n (1 < n < uj). 

(f) The Q-chain of antichains, each of size uj. 

All but (e) admit invariant measures: their amalgamation problems can be solved 
by taking the transitive closure and, when needed, linearizing, and so their ages 
exhibit strong amalgamation. Example (e) clearly has nontrivial algebraic closure, 
and so does not admit an invariant measure. 

6.1.5. Countable infinite ultrahomogeneous tournaments. 

A tournament is a structure with a single irreflexive, binary relation, — >, such 
that for each pair a, b of distinct vertices, either a — > b or b — > a, but not both. For 
example, any linear order is a tournament. The countable infinite ultrahomogeneous 
tournaments have been classified by Lachlan [Lac84] as follows. 

(a) The rationals, (Q, <). 

(b) The countable universal ultrahomogeneous tournament, T°° . 

(c) The circular tournament S(2), also known as the local order, which consists 
of a countable dense subset of a circle where no two points are antipodal, 
with x — > y if and only if the angle of xOy is less than tt, where O is the 
center of the circle. 

The ages of all three exhibit strong amalgamation (see [Che98, §2.1]). 

6.1.6. Countable infinite ultrahomogeneous directed graphs. 

A directed graph is a structure with a single irreflexive, binary relation, — >, that is 
asymmetric, i.e., such that for each pair a, b of distinct vertices, a — > b and b — > a do 
not both hold. The countable infinite ultrahomogeneous directed graphs have been 
classified by Cherlin [Che98] (see also [Che87] for the imprimitive case). Macpherson 
[Macll] describes the classification as follows (with some overlap between classes). 

(a) The countable infinite ultrahomogeneous partial orders. 

(b) The countable infinite ultrahomogeneous tournaments. 

(c) Henson's countable infinite ultrahomogeneous directed graphs with forbid- 
den sets of tournaments. 

(d) The countable infinite ultrahomogeneous directed graph omitting I n , the 
edgeless directed graph on n vertices (1 < n < ui). 

(e) Four classes of directed graphs that are imprimitive, i.e., for which there is 
a nontrivial equivalence relation definable without parameters. 
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(f) Two exceptional directed graphs: a shuffled 3-tournament 5(3), defined anal- 
ogously to the local order (6.1.5(c)) with angle 2tt/3, and the dense local par- 
tial order V(3), a modification of the countable universal ultrahomogeneous 
partial order. 

The structures in (a) and (b) are discussed above, in §6.1.4 and §6.1.5, respec- 
tively. 

Henson [Hen72] described the class (c) of 2^°-many nonisomorphic countable infi- 
nite ultrahomogeneous directed graphs with forbidden sets of tournaments. The age 
of each has free amalgamation, i.e., its amalgamation problem can be solved by tak- 
ing the disjoint union over the common substructure and adding no new relations. 
Free amalgamation implies strong amalgamation; hence on Henson's ultrahomoge- 
neous directed graphs there are invariant measures. 

The ages of the structures id. (d) have strong amalgamation. 

The first imprimitive class in (e) consists of the wreath products T[I n ] and I n [T] 
where T is a countable infinite ultrahomogeneous tournament (as discussed above 
in §6.1.5) and 1 < n < u. Each T[I n ] has nontrivial definable closure because there 
is a definable equivalence relation, each class of which has n elements. Each I n [T] 
has trivial definable closure because it is the disjoint union of copies of an infinite 
tournament that has strong amalgamation. 

The second imprimitive class in (e) consists of Q and T°°, modifications of the 
rationals and the countable universal ultrahomogeneous tournament, respectively, 
in which the algebraic closure of each point has size 2, namely itself and the unique 
other point to which it is not related. Hence neither directed graph has trivial 
definable closure. 

The third imprimitive class in (e) consists of the directed graphs n * 1^, for 
1 < n < u, which are universal subject to the constraint that non-relatedness is an 
equivalence relation with n classes. All such directed graphs have trivial definable 
closure. 

The fourth imprimitive class in (e) consists of a semigeneric variant of uj * loo 
with a parity constraint, which also has trivial definable closure. 
The ages of <S(3) and 7 ? (3) exhibit strong amalgamation. 

6.1.7. Countable infinite ultrahomogeneous graphs. 

These have been classified by Lachlan and Woodrow [LW80] as follows. 

(a) The Rado graph St. 

(b) The Henson graph and the other countable universal ultrahomogeneous 
-?T n -free graphs (n > 3), and their complements. 

(c) Finite or countably infinite union of K^, and their complements. 

(d) Countably infinite union of K n (for 1 < n < oj), and their complements. 

The ages of the structures in (a) through (c) all have strong amalgamation; in fact, 
for the Rado graph, Henson's and other K n -fiee graphs, and the complement 
of Ku, the amalgamation is even free. Hence the structures in (a) through (c) all 
admit invariant measures. The structures in (d) clearly have nontrivial algebraic 
closure, and so do not admit invariant measures. 
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6.1.8. Countable infinite connected-homogeneous graphs. 

A connected-homogeneous graph Q is a graph with the property that any partial 
isomorphism between finite connected substructures of Q extends to an automor- 
phism of Q. The countable infinite ones have been classified by Gray and Macpherson 
[GM10] as follows. 

(a) Finite or countably infinite union of copies of a fixed infinite ultrahomoge- 
neous graph. 

(b) Countably infinite union of copies of a fixed finite connected-homogeneous 
graph. 

(c) Finite or countably infinite union of copies of B, where B is the (reduct to the 
language of graphs of the) countable universal ultrahomogeneous bipartite 
graph. 

(d) Finite or countably infinite union of copies of the bipartite complement of a 
countable infinite perfect matching. 

(e) Finite or countably infinite union of copies of the line graph of K w>lJ j, the 
countable infinite complete bipartite graph. 

(f) Finite or countably infinite union of copies of certain "treelike" graphs. 

It can be seen that the graphs in (b), (d), (e), and (f) do not have trivial definable 
closure, as each is the disjoint union of copies of an infinite structure that does not 
have trivial definable closure. On the other hand, the graphs in (c) do have trivial 
definable closure, as each is the disjoint union of copies of an infinite graph with 
trivial definable closure. For the structures in (a), see the corresponding graphs in 
§6.1.7. 

6.1.9. Countable universal C-free graphs. 

Let C be a finite set of finite connected graphs. A graph Q is said to be C-free, 
or to forbid C, when no member of C is isomorphic to a (graph-theoretic) subgraph 
of Q, i.e., when no member of C embeds as a weak substructure of Q. A countable 
infinite C-free graph Q is said to be universal when every countable C-free graph is 
isomorphic to an induced subgraph of G, i.e., embeds as a substructure of Q. 

Only a limited number of examples are known of finite sets C of finite connected 
graphs for which a countable universal C-free graph exists (see the introduction to 
[CSS99] for a discussion). The best-known are when C = {K n }, for n > 3: Hen- 
son's countable universal ultrahomogeneous -fT n -free graph is universal for countable 
graphs that forbid {K n }. We consider two other families here. 

(a) The set C is homomorphism-closed, i.e., closed under maps that preserve 
edges but not necessarily non-edges. For example, take C to be the set of cycles of 
all odd lengths up to a fixed 2n + 1. Cherlin, Shelah, and Shi [CSS99, Theorem 4] 
have shown that for a homomorphism-closed set C, a canonical countable universal 
C-free graph Uq exists and has trivial algebraic closure. Hence these graphs Uc 
admit invariant measures. Such graphs lie have also been considered in [HN09]. 

(b) The singleton set C = {K m +K n } for some m,n > 2, where K m -\-K n is the 
graph onm + n- l vertices consisting of complete graphs K m and K n joined at a 
single vertex. For example, K3+K3 is the so-called bow-tie. A countable universal 
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(K m +K n )-free graph exists if and only if min(m, n) = 3 or 4, or min(m, n) = 5 but 
m ^ n ([Kom99], [CSS99], and [CT07]). Any universal {Km+K^-fiee graph has 
nontrivial algebraic closure because it must contain a copy K, of K m+n _2, but for 
any vertex v £ /C, the algebraic closure of {v} in the universal graph is all of tC. 

6.1.10. Trees and connected graphs with finite cut-sets. 

A tree is an acyclic connected graph. No tree can have trivial algebraic closure 
because there exists a unique finite path between any two distinct vertices of the tree. 
Similarly, no connected graph with a cut- vertex (a vertex whose removal disconnects 
the graph) can have trivial algebraic closure. More generally, if a connected graph 
contains a finite cut-set (a finite set whose removal disconnects the graph), then it 
cannot have trivial algebraic closure. 

6.1.11. Rational Urysohn space. 

A rational metric space is a metric space all of whose distances are rational. The 
class of all finite rational metric spaces, considered in the language with one relation 
symbol for each rational distance, is a Frai'sse class. Its Frai'sse limit is known as the 
rational Urysohn space, denoted QU (for details see [CV06]). Vershik, in [Ver02b] 
and [Ver04], has constructed invariant measures concentrated on QU. We observe 
that this fact also follows from our results, as the class of finite rational metric spaces 
has strong amalgamation. 

6.2. Structures in arbitrary languages. 

We saw in Corollary 5.2 that when a countable language L has constant symbols, 
no countable infinite L-structure can admit an invariant measure, and that when 
L has function symbols, a countable infinite L-structure can admit an invariant 
measure only when each function symbol is interpreted as a choice function, or 
selector. Thus countable infinite groups and rings cannot admit invariant measures, 
as their identity elements are in the definable closure of the empty set. However, 
there is a unique (up to isomorphism) countable infinite commutative semigroup 
that does admit an invariant measure. 

Theorem 6.1. A countable infinite commutative semigroup admits an invariant 
measure if and only if it is isomorphic to the rationals with the min operation. 

Proof. Suppose (M, *) is a countable infinite commutative semigroup with trivial 
definable closure. Define <m to be the relation on M where 

o <M b if and only if a*b = a. 

We will show that (M, <m) is a linear order. Note that * is then the min operation 
on (M,< M ). 

The relation <m is clearly reflexive. To see that it is antisymmetric, observe that 
if a <m b and b <m a then 

a*b = a and b* a = b, 

and so by commutativity, a = b. The relation is also transitive, because if a * b = a 
and b* c = b then 

a*c = a*b*c = a*b = a. 
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Because (M, *) has trivial definable closure, for all a, b E M we must have 

a*b = b*a£ {a, b}, 

and so any two elements are comparable. Hence the relation <m is a linear order. 

As we have seen in §6.1.2, the only countable infinite linear order having trivial 
definable closure is the rationals with its usual order. Hence the structure (M, <m) 
must be isomorphic to (Q, <). Note that (Q, ©), where q ® r := min(g, r), is a 
commutative semigroup that has trivial definable closure. Since the order <m com- 
pletely determines the semigroup operation of M, the semigroup (M, *) must be 
isomorphic to (Q, ©). □ 

6.3. Structures with an equivalence relation. 

Suppose we are given a countable infinite structure in a countable relational lan- 
guage with a binary relation symbol. Further, suppose that this symbol is inter- 
preted as an equivalence relation such that every equivalence class has at least 
two elements. In the case where the quotient map on the underlying set induced 
by this equivalence relation preserves the remaining relations, we can characterize 
when the original structure does or does not have trivial definable closure. On the 
other hand, starting with an arbitrary countable infinite structure in a countable 
relational language, we can "blow up" each element into an equivalence class, and 
characterize when the resulting structure has trivial definable closure. We thereby 
see that every countable structure in a countable relational language is the quotient 
of one with trivial definable closure, and of one without. We apply this result to 
obtain structures of arbitrary Scott rank that admit, or that do not admit, invariant 
measures. 

We begin by describing what it means for an equivalence relation to preserve the 
remaining relations in the language. 

Definition 6.2. Let L be a relational language, and let L + := LU {=}, where = is 
a new binary relation symbol. Let N be an L + -structure. We say that = respects 
L in M if for each fe-ary (non-equality) relation symbol R E L, 

M |= (Vxi, . . . ,x k ,yi, • • .,yk) f\ (xi = yi) -)• (R(xi, ...,x k )^ R{yi, . . -,y k )). 

l<i<k 

In other words, when = respects L in A/", then the structure N cannot 
"L-distinguish" between =-equivalent elements. In particular, the quotient map 
induced by = preserves all relations of L in N . 

For a countable infinite L + -structure N in which = respects L, and where every 
=-equivalence class has at least two elements, the size of the =-equivalence classes 
completely determines whether or not N admits an invariant measure. 

Lemma 6.3. Suppose M is a countable infinite L + -structure such that = respects 
L in N and such that no =-equivalence class has only one element. The following 
are equivalent. 

(1) Every =-equivalence class of M has infinitely many elements. 
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(2) There is an invariant measure concentrated on Af. 

Proof. Assume that (1) holds. Whenever c,c' £ Af are such that Af \= (c = c'), 
define g C( j to be the map that interchanges c and d but is constant on all other 
elements of Af. Since = respects L, the map g c c / is an automorphism of Af. 

Suppose, for a contradiction, that there are a, b £ Af such that 
b £ dcLv(a) — a. Each =-equivalence class has infinitely many elements, and so 
there must be some b' £ Af satisfying b' ab and Af |= (6 = b'). Now, g^v fixes a 
pointwise by construction. Because b £ dcLv(a), the map g^y also fixes b. Hence 
b = gb,b'(b) = b' , a contradiction. Therefore Af has trivial definable closure, and so 
by Theorem 1.1, it admits an invariant measure. 

For the converse, assume that (1) fails. By hypothesis, no =-equivalence class is 
a singleton, and so (2) fails by §6.1.1. □ 

From Lemma 6.3 we can see that, in a sense, every countable infinite L-structure 
is "close to" one that admits an invariant measure, and also to infinitely many that 
do not. Specifically, if we take a countable infinite L-structure and "blow up" every 
element into n-many elements, where n is a cardinal satisfying 1 < n < No, then the 
resulting structure admits an invariant measure if and only if n = No- 

Definition 6.4. Let L be a relational language, and let At be a countable infinite 
L-structure with underlying set M. Suppose n is a cardinal satisfying 1 < n < 'Rq. 
Let be the L + -structure with underlying set M x n such that 

|= (a, j) = (a ,f) if and only if a = a , 

for every (a,j), (a', j') £ M x n, and 

\= R((ai,j 1 ),...(a k ,j k )) if and only if M \= R(ai, . . . a k ), 

for every relation R £ L and every (oi,ji) . . . , (a k , jk) £ M x n, where k is the arity 
of R. 

In the case when Ai is a graph, this construction is known as the lexicographic 
product of Ai with the empty graph on n vertices. 

Note that = is an equivalence relation on A4^ that respects L in Ai^- Hence 
we may take the quotient of M.^ by = to obtain a structure isomorphic to M.. 
Moreover, every =-equivalence class of Ai^ has n-many elements. 

As an immediate corollary of Lemma 6.3 we have the following. 

Corollary 6.5. Let L be a relational language, let AA be a countable infinite L- 
structure, and let n be a cardinal such that 1 < n < Ho- Then Ai^ o admits an 
invariant measure, while for 1 < n < Ho, the structure Ai^ does not admit an 
invariant measure. 

The Scott rank of a structure provides a measure of the complexity of the Scott 
sentence of the structure. (For details, see [Gao07].) Corollary 6.5 provides a method 
by which to build countable structures of arbitrary Scott rank that admit invariant 
measures, as well as ones that do not. 
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Corollary 6.6. Let a be an arbitrary countably infinite ordinal. Define T a to be 
a countable linear order isomorphic to the well-order (a, G) of height a. Then the 
structure (T a )^ o has Scott rank a and admits an invariant measure, whereas for 
1 < n < Ho, the structure (T a )+ has Scott rank a and does not admit an invariant 
measure. 

Proof. The structure (T a )+ has Scott rank a, as can be seen by a simple back- 
and-forth argument with (X^)+ for (3 < a. For 1 < n < Wq, the result follows by 
Corollary 6.5. When n = 1, the result follows from the fact that the least element 
of (T a )i is in the definable closure of the empty set. □ 

7. Applications and further observations 

We conclude the paper with some observations and applications of our results. 
We describe, in §7.1, some of the theory of dense graph limits and its connections 
to our setting. 

Our main theorem, Theorem 1.1, completely characterizes those single orbits of 
Sym(N) on which an invariant measure can be concentrated. In §7.2, we ask which 
other Borel subsets of Sl, consisting of multiple orbits, are such that some invariant 
measure is concentrated on them, and we provide some observations based on our 
machinery. 

Finally, in §7.3, we note a corollary of our result for sentences of C wljU that have 
a unique model. 

7.1. Invariant measures and dense graph limits. 

As remarked earlier, our constructions, when applied to graphs, can be viewed 
within the framework of the theory of dense graph limits. We now describe this 
connection and some of its consequences. 

7.1.1. Invariant measures via graphons and W -random graphs. 

Before relating our methods to the theory of dense graph limits, we describe how 
invariant measures arise in this context. We begin with some definitions from [LS06]; 
for more details, see also [DJ08], and [Lov09, §3.1]. 

A graphon is defined to be a symmetric measurable function W : [0, l] 2 — > [0, 1]. 
In what follows, we will take all graphons to be Borel measurable. Let Lq be the 
language of graphs, i.e., the language consisting of a single binary edge relation 
E. Let Tq be the theory in the language Lq that says that E is symmetric and 
irreflexive. A graph may be considered to be an L^-structure that satisfies Tq. 
In this case, an invariant measure on Sl g that is concentrated on models of Tq is 
simply an invariant measure on graphs. 

Given a graphon W, the VF-random graph G(oo,W) can be taken to be a 
random graph in Sl g ', it is defined as follows. Let {Xk}km be an independent 
sequence of random variables uniformly distributed on the unit interval. Then for 
i,j G N with i < j, let E(i,j) hold with independent probability W(Xi, Xj); for 
each i, require that E(i, i) not hold; and for each i > j, let E(i,j) hold if and only if 
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E(j,i) does. For example, when W is a constant function p where < p < 1, then 
G(oo,W) is essentially the Erdos-Renyi graph G(oo,p), described in §1.1. Notice 
that for any graphon W, the distribution of G(oo, W) is an invariant measure on 
graphs. 

Not only is the distribution of G(oo, W) invariant for an arbitrary graphon W, 
but so are the mixtures, i.e., convex combinations, of such distributions. Conversely, 
Aldous [Ald81] and Hoover [Hoo79] showed, in the context of exchangeable random 
arrays, that every invariant measure on graphs is such a mixture, thereby completely 
characterizing the invariant measures on graphs. This characterization has also 
arisen in the theory of dense graph limits; for details see [DJ08] and [Aus08a]. 

An analogous theory to that of graphons has been developed for other combina- 
torial structures such as partial orders [Janll] and permutations [HKTM11]. The 
standard recipe described in [Aus08a] extends this machinery to the general case of 
countable relational languages. Our notion of Borel L-structure, from §3.1, can be 
viewed as a specialization of certain structures that occur in the standard recipe. In 
particular, any Borel L^-structure that is a model of Tq corresponds to a graphon, 
as we will now see. 

7.1.2. Borel La-structures and random-free graphons. 

Borel Lc-structures that are graphs are closely related to a particular class of 
graphons. Here we describe this relationship and use it to deduce a corollary about 
VF-random graphs whose distributions are concentrated on single countable graphs. 

A graphon W is said to be random-free [JanlO, §10] if for a.e. (x,y) £ [0, l] 2 
we have W(x, y) G {0,1}. (See also the simple arrays of [Kal99] and 0-1 val- 
ued graphons in [LS10].) When W is random-free, the VF-random graph process 
amounts, in the language of [PV10, ], to "randomization in vertices" but not "ran- 
domization in edges" . 

We now describe a correspondence between Borel L^-structures that satisfy Tq 
and random-free graphons. Let a be an arbitrary Borel measurable bijection from 
the open interval (0, 1) to M, and let m a be the distribution of a(U) where U is 
uniformly distributed on [0,1]. Given a Borel L^-structure 'P that satisfies Tq, 
define the random-free graphon W-p as follows. For (x,y) £ (0, l) 2 let 

Wp(x,y) = l if and only if V |= E(a{x), a(y)) , 

and for (x,y) on the boundary of [0, l] 2 let Wp(x, y) = 0. The distribution of 
G(oo,W-p) is precisely /J-{p, mct ), as defined in Definition 3.4. Conversely, given a 
graphon W that is Borel and random- free, one can build a Borel L^r-structure V\y 
satisfying Tq such that the distribution of G(oo,W) is H(p w ,m a )- 

Earlier in this paper, when we constructed an invariant measure concentrated on 
a given graph, we did not actually build a Borel L^-structure; rather, we built a 
Borel (Lc) J 4-structure, where the expansion {Lq)a of Lq contains infinitely many 
new relation symbols (see Theorem 3.20 and its proof). However, by Corollary 3.21, 
the invariant measure could instead have been formed via a Borel L^-structure 
V whose corresponding random-free graphon W-p is such that the distribution of 
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G(oo, Wp) is an invariant measure concentrated on the given graph. This leads to 
the following corollary. 

Corollary 7.1. Let Ai be a countable infinite graph. Suppose there is some graphon 
W such that the distribution of G(oo,W) is concentrated on Ai. Then there is a 
random-free graphon W' such that the distribution of G(oo,W') is also concentrated 
on Ai. 

Proof. The distribution of G(oo,W) is an invariant measure concentrated on Ai. 
Therefore by Theorem 1.1, the graph Ai must have trivial definable closure. By 
Corollary 3.21, there is a Borel L(;-structure V such that H(v >m \ is concentrated on 
Ai whenever m is a continuous nondegenerate probability measure on M. Fix some 
bijection a as above, and let Wp be the random-free graphon induced by the above 
correspondence. Then the distribution of G(oo, W-p) is ^(-p jma ), and hence is also 
concentrated on Ai. □ 

In fact, for an arbitrary countable relational language L, our procedure for sam- 
pling from a Borel L-structure essentially arises in [Aus08a] as a standard recipe in 
which all but the first "ingredient" are deterministic maps. In this setting, one can 
prove an analogue of Corollary 7.1 for arbitrary countable infinite L-structures. 

7.2. Multiple isomorphism classes. 

In this paper, we have mainly focused on the problem of identifying those count- 
able infinite -L-structures Ai such that some invariant measure is concentrated on 
the isomorphism class of Ai , i.e., on the orbit under the logic action of any structure 
in Sl isomorphic to Ai. But it is natural to investigate those larger subsets of Sl, 
consisting of the union of multiple orbits, on which an invariant measure may be 
concentrated. For example, Austin [Aus08a, Question 3.27] asks for a character- 
ization of first-order theories T such that any invariant measure concentrated on 
countable models of T must come from a standard recipe having a property akin to 
being random-free. 

There are clearly invariant measures on Sl that are not concentrated on any single 
structure, as can be seen by taking mixtures of invariant measures concentrated on 
different structures. But if there is a countable set of structures on which such an 
invariant measure is concentrated, then we can see by conditioning that there must 
be some invariant measure concentrated on one of these structures. 

Lemma 7.2. Let L be a countable language, and let T be a theory of C^ 1)U {L) that 
has at most countably many countable infinite models. Suppose fiT is an invariant 
measure on Sl that is concentrated on models ofT. Then there is a countable model 
Ai of T such that some invariant measure hm is concentrated on the isomorphism 
class of Ai. 

Proof. Because [it is countably additive and T has only countably many countable 
infinite models, there must be some countable infinite structure Ai |= T such that 
its isomorphism class Ai := {Af G Sl '■ AI = Ai} has positive //T-measure. Recall 
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that Ai is a Borel set. Let hm be \xt conditioned on this positive measure set, i.e., 
HM (A) := ii T {A | M) = [i T {A n M) / fpr (At) 

for every Borel set A C S^. Then /x_a/( is a probability measure on Sl concentrated 
on the isomorphism class of Ai . 

Moreover, fi_M is invariant, as we now show. Suppose g E Sym(N), and let A be 
an arbitrary Borel subset of Sl- Because Ai is a Sym(N)-invariant subset of Sl, we 
have 

fi T {g(A) nM)=VT (g(A) n g (M)), 
and because [It is an invariant measure, we have 

IJL T {g{AC\M)) = fi T {AnM). 
Since g(A) (lg(At) = g(An Ai), we have HM(g(A)) = ^^(A), as desired. □ 

One may ask, more specifically, given a Borel L-structure V and a continuous 
nondegenerate probability measure m, the minimum number of isomorphism classes 
on which /i(p i?n ) is concentrated. When V strongly witnesses a theory T of 
that is a pithy II2 expansion of a Scott sentence of a countable structure, then there 
is just one isomorphism class by design. However, if V strongly witnesses a pithy 
LI2 theory T of C UliUJ (L) that has more than one countable infinite model, then 
the situation is more complicated. In this case, still V |= T by Lemma 3.9, but the 
induced invariant measure might be concentrated on multiple nonisomorphic models 
of T but not on any single one. 

In fact, for a finite relational language L, this is not possible if there is a countable 
collection of isomorphism classes on which the measure is concentrated, as we state 
in the next corollary. This follows from a straightforward generalization of the 
characterization [Ald81, Proposition 3.3] of the ergodic invariant measures on graphs 
as those induced by sampling from a single graphon, rather than a mixture of such. 
(See also [Kal05, Lemma 7.35] for a presentation of this result for hypergraphs, 
[DJ08, Corollary 5.4] and [LS12, Proposition 3.6] for this result in the context of 
graph limits, and [Aus08a, §3.8] for generalizations of these settings to countable 
relational languages.) Since any invariant measure on graphs that is concentrated 
on countably many isomorphism classes, but not on a single one, is non-ergodic, the 
corollary follows. 

Corollary 7.3. Let L be a finite relational language, let V be an arbitrary Borel 
L-structure, and suppose m is a continuous nondegenerate probability measure on R. 
If there is some countable collection of isomorphism classes of Sl on which /U(-p m ) 
is concentrated, then in fact /i(p jm ) is concentrated on a single isomorphism class. 

In other words, when L is finite, for any Borel L-structure V, the measure /i(-p. m ), 
as defined in §3.1, is concentrated on either one or uncountably many isomorphism 
classes. 
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7.3. Continuum-sized models of Scott sentences. 

We conclude with a somewhat unexpected corollary of the machinery that we 
have developed. A countable structure Ai is said to be absolutely characterizable 
when its Scott sentence o~m has no uncountable models, and hence characterizes Ai 
up to isomorphism among all structures, not just among countable structures (see 
[KK04, §1.3]). Our results imply that no invariant measure can be concentrated on 
such a structure. 

Corollary 7.4. Let L be a countable language, and let Ai be a countable infinite 
L-structure. Suppose that gm> the Scott sentence of Ai, has no continuum- sized 
models. Then no invariant measure on Sl is concentrated on Ai. 

Proof. Suppose there exists an invariant measure concentrated on Ai. We will 
build a model of ctm of size continuum. Because Ai admits an invariant measure, 
by Theorem 5.1 we have dcLvi(a) = a for all a £ Ai. Now let T := {o~m} and let A 
be any countable fragment of C LOl ^ ul {L) with um £ A. If L is a relational language, 
let Ta be the pithy II2 expansion of T to A. Otherwise, let Ta be the corresponding 
pithy II2 sentence in the translation of L to a relational language, as in Section 4. 
In either case, let La be the language of Ta- Then by the argument in the first 
paragraph of the proof of Theorem 3.20, Ta has duplication of quantifier-free types, 
and hence by Theorem 3.18 there exists a (continuum-sized) Borel L^-structure 
V strongly witnessing Ta- But then V |= Ta, by Lemma 3.9, and so ctm has a 
continuum-sized model. □ 

Finally, this shows that if the Scott sentence ctm of a countable infinite structure 
Ai has no continuum-sized models (e.g., if Ai is absolutely characterizable), then 
Ai must have nontrivial definable closure. 
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